Data Engineer (ETL/Databricks) Location: Toronto, ON (Onsite- 1 day per week) Start Date: Sept 1 Length of Contract- 1 year Interview: 2 rounds (First step of process, Codility test is sent- if successful they will move to a virtual interview)
What You’ll Be Doing The role is responsible for leading the functional design and development of data pipelines and analytics, as well as AI workspace/agents largely around databricks.
In the team, the main functionality of the candidate will be to manage a data pipelines, analytics and intelligence (reporting and AI) within Databricks, PowerBI and possibly other UI tools. How You’ll Succeed
Ownership and End to End Delivery: Understand the requirements and find avenues to fill any gaps within them. Deploy code changes and unit tests along with assisting BA’s to perform functional testing. Assist QA with regression testing and make sure code is part of release timeline/package and instructions are provided to release managers. Finally verify and or assist release manager/management with deployment is necessary.
Strategic Development & Execution: Perform and coordinate solution design activities. Understand the requirements and translate them into system and application design that is aligned with our technology roadmap, using best practices and standards within the team and the enterprise. Design and document the technical functionality, infrastructure, interfaces, and integrations.
Strategy and Roadmap: Contribute to technology roadmaps that are aligned with the bank’s vision, strategy, and business objectives. Lead multiple complex technology solutions while maintaining consistency across the platform, adopting best practices and pushing forward continuous improvements
Stakeholder Management: Act as the solution lead and interface with the project/technology teams by driving and moderating design review sessions to walk stakeholders through and ensure that the overall design aligns with business requirements as well as architectural directions.
Required Skills and Experience:
Critical Requirements (2+ years’ experience):
Databricks/Snowflake (Any data warehouses)
Alternatively, strong Python
SQL/Database
Data Pipelines/ETL Processes
Good to haves:
AI based Business Intelligence / Semantics Layer / Databricks Genie
DEVOPS – CI/CD
WebAPI/Rest Services/Data APIs
Other beneficial knowledge:
UI Design and Reporting / Plotly / PowerBI
Banking/Financial Industry Experience (Particularly Capital Markets)
Medallion Data Model
Azure Cloud Services
Messaging Services (Solace/MQ)
Key Skills: Databricks and/or ETL
Also Consider: Strong Python candidates who can ramp up on Databricks quickly
AI experience: Strong asset.
Applicant Notices & Disclaimers
For information on benefits, equal opportunity employment, and location-specific applicant notices, click here
At SPECTRAFORCE, we are committed to maintaining a workplace that ensures fair compensation and wage transparency in adherence with all applicable state and local laws.The pay rate for this position is C$70.00/hr.
