smach,
@smach@masto.machlis.com avatar

The TinyChart-3B LLM answers questions about data visualizations. It can also generate underlying data from a dataviz and Python code to re-create a similar chart.

Demo on Hugging Face: https://huggingface.co/spaces/mPLUG/TinyChart-3B

Code: https://github.com/X-PLUG/mPLUG-DocOwl/tree/main/TinyChart

Paper: https://arxiv.org/abs/2404.16635 8 authors from the Alibaba Group and Renmin University of China

hrbrmstr,
@hrbrmstr@mastodon.social avatar

@smach it is failing quite miserably on virtually everything i've thrown at it so far.

eliocamp,
@eliocamp@mastodon.social avatar

@hrbrmstr I uploaded this plot and it explained it thusly:
"The chart shows a decline in the population density in the Australian state of Victoria from March 2020 to March 2021. In March 2021, the population density was 30 residents per square kilometer, down from 33 residents per square kilometer in March 2020. This represents a 7% decrease over the year."
Not very impressed.

hrbrmstr,
@hrbrmstr@mastodon.social avatar

@eliocamp it completely failed if the chart was light on dark, got one question kind of ok (for the same chart w/inverted colors, and made odd python code choices in general.

I suspect it'll get better, but manual webplotdigitizer is far more deterministic (can't wait to see the first commercial web service that uses this thing as is tho).

smach,
@smach@masto.machlis.com avatar

@hrbrmstr @eliocamp That's what I get for posting before testing it myself beyond the examples (it's been a busy weekend, out-of-town family were visiting). I thought the Alibaba group made it worth sharing. Lesson learned!

hrbrmstr,
@hrbrmstr@mastodon.social avatar

@smach @eliocamp No, it was a good share. It's going to get better, and it's going to be super cool for folks who have vision issues.

  • All
  • Subscribed
  • Moderated
  • Favorites
  • LLMs
  • DreamBathrooms
  • magazineikmin
  • modclub
  • khanakhh
  • Youngstown
  • rosin
  • mdbf
  • slotface
  • Durango
  • ngwrru68w68
  • thenastyranch
  • kavyap
  • InstantRegret
  • cubers
  • provamag3
  • osvaldo12
  • Leos
  • anitta
  • everett
  • ethstaker
  • GTA5RPClips
  • tester
  • cisconetworking
  • megavids
  • tacticalgear
  • normalnudes
  • JUstTest
  • lostlight
  • All magazines