Data Engineer
Spectraforce
Milwaukee, Wisconsin
Remote
4 days ago
Job Description
| Job Title: Data Engineer Location: Remote Duration: 14 months Job summary: Drive modern data platform architecture for a global organization by designing scalable Snowflake solutions and orchestrating resilient Azure Data Factory data pipelines in a hybrid work model. Collaborate with cross functional teams to translate complex analytics needs into secure, high performance cloud data ecosystems that enable reliable insights and responsible innovation. Experience: 10 to 14 Yrs Responsibilities: - Design end to end cloud data architectures that leverage Snowflake and Azure Data Factory to deliver reliable analytics platforms that scale with business growth and evolving data demands. - Define and maintain data modeling standards for Snowflake including warehouse structures and optimization strategies that improve query performance and reduce compute consumption. - Develop robust Azure Data Factory workflows that orchestrate complex ETL processes and ensure timely and accurate movement of data from diverse source systems into Snowflake. - Implement advanced ELT patterns in Snowflake by using efficient transformations and set based operations that enhance maintainability and reduce operational complexity. - Collaborate with data engineers analysts and application teams to translate analytical requirements into technical designs that enable trustworthy reporting and self service data access. - Establish data quality frameworks with validation rules monitoring rules and reconciliation approaches that safeguard the integrity and reliability of curated data products. - Optimize Snowflake cost and performance by fine tuning virtual warehouses storage usage micro partitioning strategies and query patterns to achieve efficient resource utilization. - Implement secure data access architectures in Snowflake and related Azure services that apply robust role based policies masking rules and auditing to protect sensitive information. - Guide the selection and integration of supporting tools for metadata management data cataloging and data lineage that provide transparency and confidence in enterprise data assets. - Create architecture diagrams design documents and reference implementations that clearly communicate patterns standards and guardrails for cloud native data solutions. - Collaborate with platform and security teams to ensure that Snowflake and Azure Data Factory implementations comply with organizational governance controls and regulatory expectations. - Provide technical oversight for complex incident resolution and performance troubleshooting efforts related to Snowflake warehouses and Azure Data Factory pipelines to minimize business disruption. - Mentor data practitioners by sharing architectural best practices design patterns and review feedback that elevate overall engineering quality and foster a culture of continuous improvement. -Qualifications - Demonstrate strong hands on expertise in architecting and operating Snowflake environments including data modeling performance optimization and secure multi domain data sharing. - Bring extensive practical experience in designing and implementing Azure Data Factory pipelines for large scale ETL and ELT workloads spanning batch and incremental ingestion scenarios. - Apply solid proficiency in Azure cloud services such as storage compute networking and identity to design integrated data solutions that are resilient and future ready. - Utilize advanced SQL and data transformation skills to define efficient processing logic and validation rules that support complex analytics and reporting requirements. - Show proven experience in enterprise data architecture data warehousing and modern analytics platforms across ten to fourteen years of progressive work in data focused roles. - Communicate clearly with technical and non technical partners to document architectures gather requirements and explain design tradeoffs in an accessible and collaborative way. |
Applicant Notices & Disclaimers
- For information on benefits, equal opportunity employment, and location-specific applicant notices, click here
At SPECTRAFORCE, we are committed to maintaining a workplace that ensures fair compensation and wage transparency in adherence with all applicable state and local laws. This position’s starting pay is: $ 52.00/daily.