davidshq,

looking to #programmatically #transform data from a proprietary #XML format into an open #JSON format, #geojson to be specific.

any suggestions on good ways to proceed using #python?

Emphasis should be placed on the transform step (e.g., I can't simply convert the XML to JSON, I need to modify fields/values).

#ETL #question

chuck,

@davidshq This may not be the best vote of confidence but everywhere i've worked that has built ETL in python it has been based on Pandas.

https://pandas.pydata.org/

Stark9837,
@Stark9837@techhub.social avatar

@chuck @davidshq

Pandas is probably the best for processing large sets of data. It is just better optimized than what your code would be. I wouldn't even try to implement it out of first principles as you would just save so much time and effort using a well-established library.

@Python #Python

  • All
  • Subscribed
  • Moderated
  • Favorites
  • python
  • ethstaker
  • DreamBathrooms
  • mdbf
  • InstantRegret
  • ngwrru68w68
  • magazineikmin
  • everett
  • thenastyranch
  • Youngstown
  • slotface
  • cisconetworking
  • kavyap
  • osvaldo12
  • modclub
  • JUstTest
  • GTA5RPClips
  • khanakhh
  • tacticalgear
  • Durango
  • rosin
  • normalnudes
  • Leos
  • provamag3
  • tester
  • cubers
  • anitta
  • megavids
  • lostlight
  • All magazines