Data Frame Library Support needed to integrate in Pythons Data Science Ecosystem. #114
Description
The current API is low level resulting in a high learning curve and manual work in order to leverage commonly used data science libraries in python like Pandas, Polars etc. I have not come across a python customer that did not use data frame libraries for post processing, data analysis and automating report generation.
Some of the pain points:
- It requires lots of iterating over objects, no table / column level operations.
- Hard to merge / join different query results (tables).
- Need for using separate clients (Data vs MetaData)
- Need for separate calls to read measurement data.
- String based queries
To better enable customer workflow's and reduce the learning curve our API needs options to return data frames. Using something like pyArrow would allow customers to choose their data frame library of choice.
Data Frames support will significantly reduce effort needed for adoption of MDS and integration with existing workflows at customers.