mycareers logo


Showing: 410 Engineer, Developer jobs
Data Engineer
Spectraforce
Milwaukee, Wisconsin
Remote

4 days ago

Job Description

Job Title: Data Engineer
Location: Remote
Duration: 14 months 

Job summary:
Drive modern data platform architecture for a global organization by designing scalable Snowflake solutions and orchestrating resilient Azure Data Factory data pipelines in a hybrid work model. Collaborate with cross functional teams to translate complex analytics needs into secure, high performance cloud data ecosystems that enable reliable insights and responsible innovation.

Experience: 10 to 14 Yrs

Responsibilities:
- Design end to end cloud data architectures that leverage Snowflake and Azure Data Factory to deliver reliable analytics platforms that scale with business growth and evolving data demands.
- Define and maintain data modeling standards for Snowflake including warehouse structures and optimization strategies that improve query performance and reduce compute consumption.
- Develop robust Azure Data Factory workflows that orchestrate complex ETL processes and ensure timely and accurate movement of data from diverse source systems into Snowflake.
- Implement advanced ELT patterns in Snowflake by using efficient transformations and set based operations that enhance maintainability and reduce operational complexity.
- Collaborate with data engineers analysts and application teams to translate analytical requirements into technical designs that enable trustworthy reporting and self service data access.
- Establish data quality frameworks with validation rules monitoring rules and reconciliation approaches that safeguard the integrity and reliability of curated data products.
- Optimize Snowflake cost and performance by fine tuning virtual warehouses storage usage micro partitioning strategies and query patterns to achieve efficient resource utilization.
- Implement secure data access architectures in Snowflake and related Azure services that apply robust role based policies masking rules and auditing to protect sensitive information.
- Guide the selection and integration of supporting tools for metadata management data cataloging and data lineage that provide transparency and confidence in enterprise data assets.
- Create architecture diagrams design documents and reference implementations that clearly communicate patterns standards and guardrails for cloud native data solutions.
- Collaborate with platform and security teams to ensure that Snowflake and Azure Data Factory implementations comply with organizational governance controls and regulatory expectations.
- Provide technical oversight for complex incident resolution and performance troubleshooting efforts related to Snowflake warehouses and Azure Data Factory pipelines to minimize business disruption.
- Mentor data practitioners by sharing architectural best practices design patterns and review feedback that elevate overall engineering quality and foster a culture of continuous improvement.

-Qualifications
- Demonstrate strong hands on expertise in architecting and operating Snowflake environments including data modeling performance optimization and secure multi domain data sharing.
- Bring extensive practical experience in designing and implementing Azure Data Factory pipelines for large scale ETL and ELT workloads spanning batch and incremental ingestion scenarios.
- Apply solid proficiency in Azure cloud services such as storage compute networking and identity to design integrated data solutions that are resilient and future ready.
- Utilize advanced SQL and data transformation skills to define efficient processing logic and validation rules that support complex analytics and reporting requirements.
- Show proven experience in enterprise data architecture data warehousing and modern analytics platforms across ten to fourteen years of progressive work in data focused roles.
- Communicate clearly with technical and non technical partners to document architectures gather requirements and explain design tradeoffs in an accessible and collaborative way.
 
Applicant Notices & Disclaimers
  • For information on benefits, equal opportunity employment, and location-specific applicant notices, click here
 
At SPECTRAFORCE, we are committed to maintaining a workplace that ensures fair compensation and wage transparency in adherence with all applicable state and local laws. This position’s starting pay is: $ 52.00/daily.

Don't miss your next Big Opportunity!

Get notified when we find an opportunity for you