Job Title : Azure Data Engineer Associate Job Location: Hybrid - work from Newark office 2-3 days in a week. Need local NJ/NY profiles ONLY. Years of Experience: 10-13.00 Years of Experience
Certifications Required : Azure Data Engineer Associate or Azure Solutions Architect Expert or equivalent cloud data certification relevant to Azure geospatial workloads preferred.
Job summary :
Data Tech team is looking for a Data Engineer to join a diverse team dedicated to providing best in class data services to our customers, stakeholders and partners.
As a part of our CDO organization, you will work with our ML Engineers, Data Scientist and various BUs to define solutions for operationalizing data driven decision making in a cost effective and scalable manner.
Responsibilities :
Bachelors degree in computer science, Software Engineering, MIS or an equivalent combination of education and experience.
Experience implementing and supporting data lakes, data warehouses, and data applications on AWS or Microsoft Azure for large enterprises Fabric is plus Programming experience with Python, Spark and SQL.
Experience with Microsoft Azure services, specifically Data Factory, ADLS Gen2, Synapse Analytics, and Synapse Database, KQL.
Experience in system analysis, design, development, and implementation of data ingestion pipelines in AWS or Azure.
Solid experience implementing solutions on AWS or Azure based data lakes preferred. Knowledge of ETL or ELT processes.
Experience with end to end data solutions -ingest, storage, integration, processing, access on AWS or Azure - preferred.
Architect and implement CI or CD strategies for EDP. Implement high velocity streaming solutions. Migrate data from traditional relational database systems, onprem to Azure technologies preferably in Onelake using Fabric technologies preferred.
Develop data based APIs Implement POCs on any new technology or tools to be implemented on EDP and onboard for real use-cases.
Any Cloud Certification preferred Azure or AWS preferred Knowledge of Microsoft Fabric technology focusing on cost and security considerations.
Requirements 10plus years of experience as a Data Engineer or Datalakes .
Experience developing business applications using NoSQL or SQL databases.
Experience working with Object stores and Structured or semi structured or unstructured data is a must. Experience with Microsoft Azure services Data Factory, ADLS Gen2, Synapse Analytics, and Synapse Database.
Develop CI or CD pipeline using Terraform and github Microsoft Fabric is plus.
Responsibilities Designing, building, and maintaining efficient, reusable, and reliable architecture and code.
Ensure the best possible performance and quality of high scale web applications and services. Participate in architecture and system design discussions.
Independently perform hands on development and unit testing of the applications.
Collaborate with the development team and build individual components into complex enterprise web systems.
Work in a team environment with product, frontend design, production operation, QE or QA, and cross functional teams to deliver a project throughout the whole software development cycle.
Responsible for identifying and resolving any performance issues. Keep up to date with new technology developments and implementations.
Participate in code reviews to ensure standards and best practices are met.
Primary :USNJNEAC01 Newark - NJ USA, CLT Alternate
Applicant Notices & Disclaimers
For information on benefits, equal opportunity employment, and location-specific applicant notices, click here
At SPECTRAFORCE, we are committed to maintaining a workplace that ensures fair compensation and wage transparency in adherence with all applicable state and local laws.The pay rate for this position is $53.00/hr.
