@scottjenson@social.coop
@scottjenson@social.coop avatar

scottjenson

@scottjenson@social.coop

UX Strategy: Apple System 7, Newton, and Apple Human Interface guidelines. UX Director at Symbian, manager Mobile UX at Google, creative director frog design San Francisco. Head of Product for two startups. Returned to Google to lead the Physical Web in Chrome and explore multiple UX research projects in Android. Left 2024, sort of retired.

mastodon.social: 2017-2022

This profile is from a federated server and may be incomplete. Browse more on the original instance.

scottjenson, to web
@scottjenson@social.coop avatar

friends.

I'm trying to convince a company to use for their very simple app. The problem is that they want to see an example of a PWA that prompts an install.

I've found a ton of good PWAs (yummly, pinterest, uber) but they either prompt to install their app😱 or just sit there an make me pull down the menu to 'install app'.

Are there any examples that actually PROMPT the user to install? I realize this needs to be done gently. I'm just looking for any example to convince them.

scottjenson,
@scottjenson@social.coop avatar

@adrian I see your info box but it doesn't actually 'install' the app, is just sends me to a page that tells me to use the menu. I'm surprised that just having an install button isn't used more often?

scottjenson,
@scottjenson@social.coop avatar

@amxmln Thank you. The problem for most commercial companies is that they are lucky to get one visit so are very reluctant to wait for the prompt from the third(?) visit. I've seen a few pages now that actually have an 'install' button and that's what they would like. I'm just surprised more PWAs don't take this approach.

scottjenson, to ai
@scottjenson@social.coop avatar

Discovered this on a #Dell product support page. Just feels too on point for the entire #AI revolution...

AI assistant on a product support page, but all of the buttons do nothing, they highlight but nothing happens.

ben, to random
@ben@werd.social avatar

“Human-centered design for engineers”: a book for engineers on small teams who want to be more effective with fewer resources and solve real, unmet problems for the people they’re building for more quickly than they otherwise might.

scottjenson,
@scottjenson@social.coop avatar

@ben suggest it includes the quote "months of programming can save you days of critical thinking"

calmeilles, to random
@calmeilles@mstdn.social avatar
scottjenson,
@scottjenson@social.coop avatar

@tob @thedarknite @calmeilles thank you, exactly my point

scottjenson, to ai
@scottjenson@social.coop avatar

For innovation, should Big Tech be our only choice?

The assumption so far is that AI is just too big for normal developers, so we have no choice but to let Big Tech figure it out. There is likely some truth to this, but I'd like us to live in a world without silos. Every single company pursuing AI right now is using it to buttress their own silo. This may indeed be the simplest solution in the short run, but I'd like us to have at least the aspiration of something bigger.
1/2

scottjenson,
@scottjenson@social.coop avatar

For example, it's clear that are great at parsing, summarizing, and composing text (both human and computer languages). If we were to have a range of "input bots" that gathered data from various places (e.g., banks, calendars, the DMV) and a series of "output bots" that visualized that information, LLMs could be the glue connecting these together, creating an enormous range of applications, triggers, and assistants. But we have to want this to be an open system.
2/2

bruces, to random
@bruces@mastodon.social avatar

*I bet it wasn't all that boring if you were a Google AI and you were just automatically scanning it

https://gizmodo.com/google-io-boring-gemini-ai-1851485806

scottjenson,
@scottjenson@social.coop avatar

@bruces I just left Google, they have AI fever. This is NOT something driven by a user need. It is a stone cold panic that they are getting left behind.

The vision is that there will be an Ironman Jarvis in your phone that locks you into their ecosystem so hard, you'll never leave. That is just catnip and they can't afford to let someone else get there first. (Apple is no different)

When the emperor, eventually, has no clothes, they'll be lapped by someone thinking bigger.

scottjenson, to LLMs
@scottjenson@social.coop avatar

Saying "LLMs will eventually do every job" is a bit like:

  1. Seeing Wifi wireless data
  2. Then predicting "Wireless" Power saws (no electrical cord or battery) are just around the corner

It's a misapplication of the tech. You need to understand how #LLMs work and extrapolate that capability. It's all text people. Summarizing, collating, template matching. All fair game. But stray outside of that box and things get much harder.

scottjenson,
@scottjenson@social.coop avatar

@mattwilcox Oh, I agree. But there will be domains where it's transformative, e.g. programming. This has completely transformed how I code. I'm still driving, but DAMN is it handy.

I expect it'll transform online help significantly (I hope for the better!) It will likely transform Law in many ways. I don't expect it'll replace lawyers, just allow them to review and output boilerplate much faster.

It's the Gartner hype cycle all over again. People are freaking out and it'll pull back.

scottjenson, to Figma
@scottjenson@social.coop avatar

I just tried a few AI plugins for #figma and they were all bad. This domain might be a great test for #LLMs . I predict these failings are unlikely to be fixed any time soon:

  • Layout was poor
  • They can't create components
  • Laughably complex object hierarchies (everything was enclosed in a frame)

Of course things will improve, but I expect fixing these deep structural problems are a function of many new constraints, likely beyond what today's LLMs are actually capable of. @simon ?

scottjenson,
@scottjenson@social.coop avatar

@simon my point being there are limits as to what #LLMs can do:

Structural
There is no clear API to "genAI" components

Training
There is very little training data on how to create a clean Figma object structure

These may be solved, eventually, but they also are likely quite different from the chat based solution patterns offered today. My concern is that it's much harder than boosters believe.

davew, to random
@davew@mastodon.social avatar

Do people understand the impact ChatGPT can have on how we control our software? No more hunting through menus among a thousand options to figure out how to do something. Just use natural human language. The UIs we've had to design and live with will be a thing of the past. Yet no one seems to be talking about this.

scottjenson,
@scottjenson@social.coop avatar

@davew People in the UX community are most certainly talking about this. There is tremendous potential here. There is a tendency though for more technical users to over-index on typing as a perfect experience. For repetitive tasks, it can get old. This doesn't take anything from you point. To the contrary, it's WHY we're talking so much about this.

Strapping an LLM powered CLI into an app is an obvious first step but we'll likely do something much more interesting

scottjenson,
@scottjenson@social.coop avatar

@chrisgervais @davew exactly. that type of "let me describe it and it'll do all the work for me" type front end seems like a very interesting direction to go. The gotcha, however, is how often is it going to get it wrong? Even describing something to another human is error prone!

matthiasott, to UX
@matthiasott@mastodon.social avatar

A little quiz: in which of those two inputs will your password be visible aka unmasked? 🤔

scottjenson,
@scottjenson@social.coop avatar

@matthiasott This is a UX problem as old as time. It's why checkboxes were invented. They are a label AND a state! I understand there is a need for minimalism but it's basic UX Algebra: an icon can be either an action OR a state not both.

The solution is to make it a button and 'sneak in' state someone, e.g. grey prompt text in the text area that toggles with the icon (there are likely better ways to do it)

scottjenson, to random
@scottjenson@social.coop avatar

@simon
Simon, I'm working with @homeassistant a bit and we just had a fascinating discussion about 'nanoLLMs' that could run locally. They would NOT need the sum-total-of-all-human-knowledge but would really just be there as a smart parser for speech-to-text commands, keeping everything local. This is clearly still not trivial but hopefully one way to reduce the model size.

Do you know of any 'reduced' LLMs that could work in this more limited context?

scottjenson,
@scottjenson@social.coop avatar

@simon @homeassistant Excellent news, thank you. I'll get started running it locally on my Mac just to get started

scottjenson,
@scottjenson@social.coop avatar

@simon @homeassistant Thanks again. I'll also give that a try. I'm currently running it with Ollama on a 5 year old desktop (it was shockingly easy) It's only using 30% of the CPU when I ask it a question!

Even then, I'd (naively?) suggest that it is far more power than I need. But the fact that I can get this far in just 5 minutes has me shaking my head in disbelief.

scottjenson, to ChatGPT
@scottjenson@social.coop avatar

My experimentation with + programming has been a mixed bag:
Pros:

  • It often gets it right the first try
  • It's faster to change the prompt than edit the code
  • it can explain code fairly well

Cons

  • I can ask the exact same prompt and get different code that WONT work!
  • After several iterations, the code just stops compiling
  • I frequently save revisions of files so I can upload a working file and iterate from there.
  • It's SO SLOW to wait for it to type out
scottjenson,
@scottjenson@social.coop avatar

I've been wading into code/APIs I have zero experience with and making remarkable progress. I'm thinking of it as creating a good starting tutorial.

I'm still giving it fairly tiny utility programs (I am just prototyping crazy stuff) I'm not building anything complex. But as a Designer the fact that I can build a working prototype in or so damn fast is remarkable.

davew, to random
@davew@mastodon.social avatar

I can’t wait for the UIs of settings on systems like Mac Or Android to go through the AIs. No more hunting through menus to not find the setting where you’re sure it should be.

scottjenson,
@scottjenson@social.coop avatar

@davew MacOS has a nice feature where if you searched in the settings app, it included dozens of synonyms so if you searched for "audio" it would find "sound" etc. An AI interface could do this MUCH better.

However, it doesfeel like were going back to CLIs a bit doesn't it? Having to always type to get anything done? It is, of course, a really clever CLI, but might feel a bit tedious if it's the primary way you need to use it (audio just doesn't work in many so many social situations)

scottjenson, to random
@scottjenson@social.coop avatar

The world needs some cross between Processing, HTML, and Google Docs.

Processing: A programming environment with lots of helpful libraries
HTML: a simple display model that can be viewed everywhere
Docs: an underlying sharing mechanism

There are just too many core problems that need to be solved over and over by each app. It's more than just getting the right library as there are services involved.

Surely someone has taken a crack at this?

scottjenson,
@scottjenson@social.coop avatar

Any yes, HTML/JS/CSS can be used to build anything, but that's a bit like saying Assembly language can build any app: At some point you don't want to keep reinventing the wheel.

Of course, EVERY programming environment has tried this and it's nearly impossible to get something to work universally. I'm just asking for a very opinionated set of services and libraries on top of the web so it's really stupidly easy to build and SHARE things easily.

Kind of like Glitch but with a few more mix-ins

scottjenson,
@scottjenson@social.coop avatar

@maximvdw Very cool. It appears to be very storage focused (which is a great start) but does it have a Glitch-like side that allows for programming that data?

scottjenson, to Futurology
@scottjenson@social.coop avatar

Whenever I explain my at Google into mobile text editing, I'm usually met with blank stares or a slightly hostile "Everyone can edit text on their phones, right? What's the problem?"

Text editing on mobile isn't ok. It's actually much worse than you think, an invisible problem no one appreciates. I wrote this post so you can understand why it's so important.
https://jenson.org/text

scottjenson,
@scottjenson@social.coop avatar

@whynothugo I actually call that out in the paper and now it DOESN"T solve the fat finger problem. It certainly helps (It's on Android as well) Your comments about the inline menu shows some of the differences between iOS and Android however, the reason I go into such tedious detail about taps and mistaps is that even on iOS is't still an ambiguous state machine and things can go wrong, i.e. I place my cursor in a text field and have to tap it AGAIN in order to get the menu..

  • All
  • Subscribed
  • Moderated
  • Favorites
  • provamag3
  • InstantRegret
  • ethstaker
  • osvaldo12
  • magazineikmin
  • GTA5RPClips
  • rosin
  • mdbf
  • Youngstown
  • Durango
  • slotface
  • everett
  • kavyap
  • DreamBathrooms
  • JUstTest
  • thenastyranch
  • tacticalgear
  • modclub
  • cisconetworking
  • tester
  • cubers
  • khanakhh
  • ngwrru68w68
  • normalnudes
  • megavids
  • anitta
  • Leos
  • lostlight
  • All magazines