Job Information
Maestro Technologies Sr. Data Engineer in Trenton, New Jersey
Create data pipelines in Snowflake to ingest data from upstreams that are received in Azure blogs. Configure data pipelines in ADF to push data in Azure blob storage. Perform ad hoc data investigations and clear data blockers for the Data Science team. Create Snowflake stored procedures to perform data transformations. Perform data analysis to identify data load gaps received from upstream systems. Create Python modules to scan Business queries to list all IT/Business Tables/Columns that are in scope for migration. Create Excel Macro modules to scan Shell programs and generate dependency matrix to validate programs migration into enterprise model infrastructure. Create data quality rules in ICDEQ. Rewrite LDW scripts that were created by Business to Snowflake EDM Model. Track data analysis gaps with multiple stakeholders to ensure data that was available in LDW are transformed and loaded into EDM as expected.REQUIRES: Associate’s degree or equivalent in Computer Science, Information Technology or Mathematics + minimum 2 years experience as Sr. Data Engineer, Data Engineer, Data Scientist, Data Analyst, Big Data Developer or related.JOB LOCATION: Trenton, NJ & unanticipated locations throughout US.