From my existing Azure Data Lake, I have daily JSON files that are heavily nested. I need these files flattened and put into a tabular SQL database so that I can access the data more easily from other tools & apps.
Goal: Pull the data from the JSON files in the Azure Data Lake, extract the data, flatten the data into a structure that can be uploaded to a SQL database.
• Use the Azure Cloud stack (Data Factory, Function, Logic App, etc)
• Flatten JSON files in existing Azure Data Lake -- There is a file for each day
flattened data out
• Upload flattened data into SQL database
• Need some documentation on how this process is done so that I can replicate it
o What Azure tool
o How to make any needed adjustments for future use (ie: changing dates, file locations, SQL database, etc)
I have found this example using Azure Logic App (the solution doesn't have to be Logic App) that could be a template: [login to view URL]
I've attached an example of the daily JSON file.
9 freelancers are bidding on average $185 for this job
Hello! I'd like to deliver optimized data access. I'm familiar with c++ processing of json, python, windows platform. I'll do the job fairly good. Please, give me a try!
Programming language I will use C#. You are ok please give a call on this number +91 7598412675 Relevant Skills and Experience Azure developer , [login to view URL], c#, azure devops , java