Senior Data Engineer

1 month ago


Ontario Canada, Canada Bitstrapped Full time

We are seeking a hands-on Senior Data Engineer in a full-time salaried position. The Sr. Data Engineer will work with our Data Services Practice and work alongside our talented cloud architects to play a key role in our delivery teams.

The Data Engineer will be involved in the design, programming, and implementation of data platform components and serve as a hands-on consultant to our customers. The Data Engineer will work mostly on Google Cloud, interacting with other platforms such as AWS or Microsoft Azure in hybrid environments.


Responsibilities


  • Design, implement, automate, and maintain enterprise data systems for our customers
  • Implement data engineering technologies, primarily stream and batch processing systems with Apache Beam/Dataflow, Data Warehouses including BigQuery, queuing and message systems with Pub/Sub, Data Lakes with BigLake and Cloud Storage, application databases including SQL and Postgres, Redis, and Composer DAG-based workflow automation
  • Show an ability to implement data system robustness including caches, clustering, partitioning, event windows, performant and cost efficient data warehouse queries, audit tables, data governance and security including RBAC and CBAC
  • Capable of balancing 1-2 client projects with differing project priorities
  • Write reusable and scalable code, prioritizing a test driven approach where possible
  • Experience working with project plans and milestone based sprints, under the supervision of technical project management and principal architects
  • Hands-on experience with relational and non-relational databases, as well as file types that include Parquet, Avro, csv
  • Strong verbal communication skills
  • Possess a desire to continuously learn and adopt new technologies
  • Possess a desire to work in a fast paced environment
  • Be capable of working independently, staying on task, and remaining productive with little supervision



Minimum Requirements


  • 5+ years experience as a data engineer or software engineer in a professional environment
  • 5+ years of experience with data engineering duties including data ingestion, data processing, ETL/ELT, parallel computing, integration of sinks/taps, workflow orchestration
  • Strong knowledge of databases and data storage
  • Ability to architect, develop, and test code at an enterprise level, adhering to software engineering best practices
  • Ability to Design data models with a strong understanding of modeling design patterns.
  • Proficiency in at least one programming language.
  • Has knowledge and experience working on distributed systems (monitoring, alerting, message contracts)
  • Cloud Certifications - GCP Data Engineer certification preferred



Bonus


  • Experience in Data Science and Data Science Engineering
  • Experience with the deployment of workloads to the cloud
  • Experience interacting with other cloud infrastructure services including Cloud Functions, Kubernetes, or VertexAI is a nice to have
  • Experience with DevOps CI/CD workflows using technologies such as Github, Gitlab, Jenkins, CircleCI, Bitbucket, and otherDevOps Technologies.
  • Experience writing infrastructure as code using Terraform


About Bitstrapped

Bitstrapped is a fast-growing consulting firm with Data and AI services practices. Our passion lies in our ability to help companies invest in forward-thinking data-to-AI infrastructure. Investments in these areas enable our customers to distinguish their brands from their competition, stay competitive, and produce better business outcomes.

We help our customers architect solutions for the cloud, advanced data engineering, MLOps, and AI infrastructure. This includes engineering systems for data ingestion, data transformation, data warehousing, data migrations, and the application of machine learning. We are a Google Cloud partner. However, we work with other major cloud platforms.

Benefits

Health benefits, including medical, dental, and vision coverage.

Subsidy for certifications.

Subsidies for home-office equipment.

Assistance for fitness plans.


We encourage applications from people who look, feel, and think differently than members of our current team. We value candidates with non-linear career paths, and people who find themselves underrepresented or underestimated, especially in technical spaces. We encourage applications from people with caregiving responsibilities.


  • Senior Data Engineer

    2 months ago


    Ontario, Canada, Canada Centrilogic Full time

    Senior Data EngineerWe are looking for passionate and experienced Senior Data Engineer to work with our other 70+ software, data and DevOps engineers to guide and assist our clients’ data modernization journey.This is a contract opportunity to work with our team who supports companies with ambitious missions - clients who are creating new, innovative...


  • Ontario, Canada, Canada Major Recruitment Full time

    Supply Chain, Lean Planning & Scheduling Engineer - Senior Level **MUST BE A Canadian Citizen**My client is seeking Lean Six Sigma Supply Chain and Manufacturing Operations Engineers to re-engineer supply chain functions. Must be an expert in multiple disciplines, including ERP functionality, procurement, production planning, BOM and/or configuration...

  • PLC Control Engineer

    3 weeks ago


    Ontario, Canada, Canada Hymson Full time

    Job Responsibilities:1. PLC programming: Write and optimize PLC programs according to project requirements to ensure they meet production needs.2. System debugging: Conduct on-site debugging to ensure the stability and reliability of the control system.3. Troubleshooting: Perform fault diagnosis on automation equipment, quickly solve problems, and reduce...


  • Ontario, Canada, Canada Hymson Full time

    Responsibilities:1. Responsible for equipment debugging after mechanical and electrical installation.2. Responsible for assisting in resolving mechanical interference and identifying design defects.3. Responsible for recording, providing feedback, analyzing, troubleshooting, and promoting lateral improvement during the debugging process.4. Responsible for...

  • Mechanical Engineer

    3 weeks ago


    Ontario, Canada, Canada Hymson Full time

    Job Responsibilities:1. Design and development: Design mechanical components and systems, use CAD and SolidWorks software for modeling and drawing.2. Product testing: Develop and implement a testing plan to ensure that the product meets design specifications and performance standards.3. Technical support: Provide technical support to solve mechanical...


  • Ontario, Canada, Canada Gemini Solutions Pvt Ltd Full time

    Position: Senior Python DeveloperJob Location: Toronto, Canada/RemoteJob Type: Full TimeImmediate InterviewPosition Responsibilities:Excellent knowledge of data structuresUnderstand client requirements and propose solutionsDesign and develop the systemWork with Database integrationSupport users by developing documentation and assistance tools.Ensure designs...


  • Ontario, Canada, Canada Locke Bio Full time

    Job DescriptionAbout Locke BioAt Locke Bio, we are revolutionizing the healthcare space through digital innovation. Our white-labeled telehealth platform allows brands to launch customized healthcare services from patient intake to consultations, e-commerce payment processing, and beyond. With a seamless integration of pharmacy networks and telemedicine...


  • Ontario, Canada, Canada Holt Executive Ltd Full time

    Holt Executive are partnered with a leading Global Satellite and Space leader that provides reliable and secure satellite-delivered voice and high-speed data communications solutions to broadcast, telecommunications, corporate and government customers worldwide. They are now developing a LEO constellation that will revolutionize global broadband connectivity...


  • Ontario, Canada, Canada Appficiency Inc. Full time

    Solving the most complex technology and business challenges is what Appficiency is about. As the top partner for creating the new industry benchmarks in the ERP Services, Appficiency is an Oracle NetSuite Alliance Partner with over 7 different industry and partner awards. We are a leader in both construction and manufacturing and as a top 5 Alliance Partner,...


  • Ontario, Canada, Canada Altis Technology Full time

    Job Title: Full Stack Software Engineer (Mid to Senior Level)Location: Remote.Job Type: Full-Time (Permanent)Job Description:We are seeking a talented and motivated Full Stack Software Engineer to join our dynamic team. As a mid-level engineer, you will play a critical role in the design, development, and maintenance of our applications. You will work on...

  • Data Engineer Analyst

    2 weeks ago


    Quebec, Canada, Canada Bombardier Full time

    Why join us?At Bombardier, we design, build and maintain the world’s peak-performing aircraft for the world’s most discerning people and businesses, governments and militaries. We have been successful in setting the highest standards by putting our people at the heart of it all, and defining excellence, together. Working at Bombardier means operating at...

  • Senior Researcher

    3 weeks ago


    Ontario, Canada, Canada Bentham Science Full time

    We are currently seeking Editorial Board Members for "The Open Biotechnology Journal"We are seeking experienced researchers and scientists to join us as Editorial Board Members for the journal, "The Open Biotechnology Journal".About the Role:Actively contribute to the development and growth of the journal by providing valuable scholarly input, including the...

  • Junior Cyber Engineer

    3 weeks ago


    Nova Scotia, Canada, Canada Albany Beck Full time

    Albany Beck is consultancy that specializes in delivering tailored solutions in technology, risk, and business transformation. They work with clients in financial services, government, and other industries, providing expert consulting services, project delivery, and talent solutions to help organizations manage change, drive innovation, and optimize...

  • Mine Geologist

    3 weeks ago


    Ontario, Canada, Canada CSG Talent Full time

    CSG Talent is proud to collaborate with a global leader in underground mining and assist them in the search of a Mine Geologist on a residential basis.In this exciting role you will provide quality mine geology services and work collaboratively with the broader Mining Team to maximise return for the operation. Mapping/sampling and the efficient extraction of...

  • Development Team Lead

    3 weeks ago


    Ontario, Canada, Canada Randstad Digital Full time

    My client is a government agency who provides financial programs to Ontario households. They are looking for IT Team Leader to join the team. Position will be leading a team of 3 in participating in daily operational and production support activities of .Net web applications and GIS running on ESRI ARCGIS 10.9.1 and VertiGIS platform for internal and...


  • British Columbia, Canada, Canada Kerry Search Partners Full time

    Join the Frontlines of Blockchain Innovation as a Software Engineering Manager: Real-time Data Analytics and Blockchain! Are you passionate about pushing the boundaries of blockchain technology? Our client, a cutting-edge data company specializing in real-time analytics for decentralized applications (dApps), is looking for an exceptional Software...

  • General Manager

    3 weeks ago


    Ontario, Canada, Canada CAD Industries Ferroviaires Ltée Full time

    Company Summary: Cad Rail Industries Ltd was founded in 1968 headquartered in Montreal. We take pride on being North America’s leader of full-service solutions in the freight, passenger and commuter rail industries in Canada, the United States and offshore. Cad Rail has other facilities in Calgary, Lethbridge (under Caltrax banner) and has recently been...

  • Proposal Manager

    3 weeks ago


    Ontario, Canada, Canada SACYR USA & CANADA Full time

    Position SummaryAs a member of the Concesiones development team, the role of the Senior Project Manager – Project Development (“SPM”) is to lead P3 bidding process from a developer/equity investor perspective on P3 social and transportation projects across a Canada.The SPM will have management responsibilities which commence upon the identification of...

  • Technical Consultant

    3 weeks ago


    Ontario, Canada, Canada THOMAX Full time

    The CompanyThomax is a leading developer of cloud software for logistics clients both within Australia and internationally with our technology powering millions of parcel movements annually across a wide range of sectors and businesses. We are rapidly growing local success story, seeking to fill multiple important roles as soon as possible – don’t miss...

  • Environmental, Health

    3 weeks ago


    Ontario, Canada, Canada DCM Full time

    Position: Environmental, Health & Safety and Quality ManagerType: Full Time PermanentLocation: OntarioDCM is a communication solutions partner that adds value for major companies across North America by creating more meaningful connections with their customers. We pair customer insights and thought leadership with cutting-edge products, modular enabling...