And they’re leaving it in my hands 🙃
Anyone have any suggestions for tools/technologies to look into? It will most likely take the form of csv extracts from system A with fields/objects to be mapped to system B.
Also, this question is truly an instance of how the internet is a fucking wasteland. I could’ve asked this question 5 or 6 years ago on Reddit and gotten something meaningful, but today I would get replies from tons of company accounts trying to sell me their garbage solutions based on LLM wrappers
Use
dbt, host it on whatever they got (vSphere, cloud VMs, w/e) or schedule it the same way their “Devops” or “CICD” pipelines are orchestrated. Makes it easier if you wind up having a bunch of workers move data in parallel during the migration window or if you need to do a rolling refresh of the destination for validation or something.If you can get access to the source database, query the
INFORMATION_SCHEMAviews (select * from information_schema.columns) to get the data types of the fields in the source system. Same for the destination it sounds like, but once you have the columns and tables present in both systems you can probably start mapping it easily or chatbots probably do OK at it.What is dbt? Dealing with azure here too, but no access to anything other than SOQL (platform sits on top of salesforce)