Data Engineer

3 weeks ago


Vancouver British Columbia BB, British Columbia, Canada Insight Global Full time

Location: Remote (must be in Vancouver for occasional visits and onboarding)

Duration: Permanent


Required Skills & Experience


• Bachelor's degree in Computer Science, Information Technology, or a related field.

• Proven experience as a Data Engineer with a focus on SQL Server and Data Warehouses like Snowflake.

• In-depth knowledge of SQL Server database design, query optimization, and performance tuning.

• Proficiency in writing complex SQL queries and stored procedures.

• Experience with database scalability and writing deep queries accessing large datasets

• Experience with ETL tools and processes (eg. SSIS (must have but its going away), Airflow, AWS Glue, Talend, or similar).

• Experience with cloud technologies (S3 [AWS], EC2, Linux [some exposure, not looking for admin, some scripting in linux just using it for deployment])

• Experience with GitHub and CICD systems

• Experience with database security best practices.

• Excellent problem-solving and analytical skills.

• Effective and proactive communication skills and ability to work collaboratively in a team environment.


Nice to Have Skills & Experience


• Knowledge of cloud-based database solutions (e.g., Amazon RDS (SQL Server), Azure SQL Database).

• Experience with cloud Orchestration tools (e.g. Airflow, Talend, ADF, etc)

• Experience with other database technologies (e.g., MySQL, PostgreSQL).

• Certification in SQL Server or related technologies.

• Experience of Geo Spatial data and queries


Citusdata


Job Description


Insight Global is seeking a Senior Data Engineer to join a global housing market data insights and solutions firm. As a Senior Data Engineer, you will play a crucial role in designing, implementing, and optimizing our data infrastructure. You will be embedded in an application scrum team working on a large-scale application. Your expertise in SQL Server query optimization, Snowflake, and performance tuning will be instrumental in ensuring the efficiency and reliability of our data systems.

Database Design and Development:


• Design and implement robust, scalable, and performance-optimized database solutions using SQL Server and Snowflake.

• Develop and maintain database procedures, schemas, tables, indexes, and views to support application requirements.


SQL Server Query Optimization:


• Analyze and optimize SQL queries for maximum efficiency and performance.

• Identify and resolve performance bottlenecks in database systems through the use of query plans.

• Collaborate with application developers to enhance query performance and database responsiveness.


Data Modeling:


• Work closely with data engineering to design and implement data models that align with business requirements.

• Ensure data integrity and consistency across the database environment.


ETL Processes:


• Design, implement, and maintain ETL processes for efficient data extraction, transformation, and loading.

• Collaborate with cross-functional teams to integrate data from various sources into the SQL Server database.


Monitoring and Maintenance:


• Implement effective monitoring solutions to proactively identify and address potential issues.

• Perform routine maintenance tasks such as backups, restores, data purges, and index de-fragmentation.

• Experience with Unix and Powershell scripting technologies (running back scripts, basic) --> SSIS for defining ETL pipelines so has call command lines and wil lcall from powershel, backfile, move datafile into S3, scripting simple stuff, not advanced


Collaboration and Documentation:


• Collaborate with cross-functional teams, including data scientists, product analysts, and application developers, to understand data requirements.

• Participate in architectural discussions and technical decision-making processes.

• Effectively communicate technical concepts to non-technical stakeholders.

• Document database design, configurations, and procedures.


  • Senior Data Engineer

    3 weeks ago


    Vancouver, British Columbia, B6B, British Columbia, Canada Insight Global Full time

    What You’ll DoData Pipeline Processes: Design, implement, and maintain data pipeline processes for efficient data extraction, transformation, and loading.Collaborate with cross-functional teams to integrate data from various sources into target databases.Database Design and Development: Design and implement robust, scalable, and performance-optimized...


  • Vancouver, British Columbia, B6B, British Columbia, Canada S.i. Systems Full time

    Our public client is looking for a Senior Data Engineer with expertise in cloud-based data engineering to design and develop scalable data architectures and pipelines and ensure data integration, governance and analytics.NOTE: This is a 12-month contract, hybrid model. Must work in the Vancouver office 3 days a week. This role will involve making key...


  • Vancouver, British Columbia, B6B, British Columbia, Canada Insight Global Full time

    Insight Global is looking for a Data Security Engineer to join one of Canada's largest retail and wellness companies. This individual will be joining the Cloud Data Platform team that focuses on securing data as it flows from one system to another. The ideal candidate will be responsible for the following:Analyze data protection risk scenarios within the...


  • Vancouver, British Columbia, B6B, British Columbia, Canada Computational Geosciences Inc. Full time

    Are you an experienced Machine Learning Engineer with a passion for high-performance computing (HPC) on AWS? Do you enjoy working on cutting-edge computational challenges, including computer vision and geospatial data applications? If so, we want to hear from you!About the RoleWe are seeking a Machine Learning Engineer with expertise in HPC and data science...


  • Vancouver, British Columbia, B6B, British Columbia, Canada Microsoft Canada Full time

    Microsoft is a company where passionate innovators come to collaborate, envision what can be and take their careers further. This is a world of more possibilities, more innovation, more openness, and the sky is the limit thinking in a cloud-enabled world. Microsoft’s Azure Data engineering team is leading the transformation of analytics in the world of...

  • Data Architect

    4 weeks ago


    Vancouver, British Columbia, B6B, British Columbia, Canada Randstad Digital Full time

    Data Architect (Contract Position)Number of Positions: 1 Duration: 6 months, possible extensionLocation: Vancouver, BC, CAMust be eligible to work in CanadaHybrid position, must be onsite 3days a week, nonignitable Roles and responsibilities:Looking to hire a highly skilled Data Architect to design, develop, and implement scalable data solutions. This role...


  • Vancouver, British Columbia, B6B, British Columbia, Canada Alquemy Search & Consulting Full time

    Business Intelligence (B.I.) Engineer10 month contract, high potential to extend"Hybrid" work environment - 3 days per week in downtown Vancouver officeDesired skills & experience:SQLStrong programming skills with PythonDeveloping data ETL, data sources and dashboardsGoogle Cloud Platform (GCP)BI engineering with data processing tools such as Spark and...

  • Mechanical Engineer

    4 weeks ago


    Vancouver, British Columbia, B6B, British Columbia, Canada DBSI Services Full time

    Job Role- Mechanical EngineerJob Location- Vancouver, British Columbia, CanadaJob DescriptionMechanical engineers with 5+ years of experience in cost engineering, pricing analysis (from manufacturing or automotive environment), or a related field, ideally within a manufacturing or automotive environment.5+ years of experience in Should costing & Supply chain...

  • DevOps Engineer

    3 weeks ago


    Vancouver, British Columbia, B6B, British Columbia, Canada Insight Global Full time

    Required Skills & Experience•Has 8+ years of experience in a support and/or operational role relating to site reliability, DevOps or CI/CD processes•Has an understanding and knowledge of CI/CD concepts, DevOps Processes and GitLab or has previously been a Site Reliability Engineer or DevOps Engineer•Previous experience making configurations/feature...

  • DevOps Engineer

    3 weeks ago


    Vancouver, British Columbia, B6B, British Columbia, Canada Insight Global Full time

    Job Title: DevOps EngineerJob Type: 6 month contract + possibility of extension (Hybrid, 4 days on site), Vancouver BCJob Salary: $75 - $85 HourJob Description Insight Global is looking for a DevOps to join one of North American’s largest retail and wellness companies. The ideal candidate will be joining the Enterprise Platform Engineering team that is...


  • Vancouver, British Columbia, B6B, British Columbia, Canada FutureTech Recruitment Full time

    Director of EngineeringVancouver (hybrid)$200-250k CADWe are partnered with an exciting, fast-growing Series A start-up on a mission to structure scattered conversations for sales teams into high-quality insights using AI. They’re looking for a Director of Engineering to lead and expand their team.Responsibilities:Recruit, develop, and expand a top-tier...


  • Vancouver, British Columbia, B6B, British Columbia, Canada Ztek Consulting Full time

    Title - Mechanical EngineerLocation - Vancouver, British Columbia, Canada (onsite only)Years – 5 to 7 years Mandatory Skills:Mechanical engineers with 5+ years of experience in cost engineering, pricing analysis (from manufacturing or automotive environment), or a related field, ideally within a manufacturing or automotive environment.5+ years of...


  • Vancouver, British Columbia, B6B, British Columbia, Canada Ztek Consulting Full time

    Title: Manufacturing Cost EngineerLocation: Vancouver, British Columbia, Canada (onsite only)Experience: 5 to 7 yearsMandatory Skills:• Mechanical engineers with 5+ years of experience in cost engineering, pricing analysis (from manufacturing or automotive environment), or a related field, ideally within a manufacturing or automotive environment.• 5+...

  • Software Engineer

    3 weeks ago


    Vancouver, British Columbia, B6B, British Columbia, Canada Microsoft Canada Full time

    The Experience plus Devices (E+D) Growth team is seeking a Software Engineer II to help accelerate the adoption of Copilot and Microsoft 365. Our team is uniquely positioned at the strategic epicenter of E+D for revolutionizing the productivity business by delivering embedded experiences across the Microsoft 365 suite (Teams, Outlook, Word, PowerPoint,...


  • Vancouver, British Columbia, B6B, British Columbia, Canada S.i. Systems Full time

    Our multinational SaaS company client in Vancouver is looking for a Senior Data Analytics Manager to lead data analytics initiatives, develop scalable analytics solutions and drive data-driven decision making to support business growth and strategy.This role is a permanent full-time, 2-3 days in their office in Vancouver, BC. Must Have: 5+ years'...


  • Vancouver, British Columbia, B6B, British Columbia, Canada FutureTech Recruitment Full time

    VP of EngineeringVancouver (hybrid)$200-250k CADWe are partnered with an exciting, fast-growing Series A start-up on a mission to structure scattered conversations for sales teams into high-quality insights using AI. They’re looking for a VP of Engineering to lead and expand their team.Responsibilities:Recruit, develop, and expand a top-tier engineering...


  • Vancouver, British Columbia, B6B, British Columbia, Canada S.i. Systems Full time

    Our public sector client is seeking a Senior Data Architect to provide design strategies and set standards for a new multi-year program to modernize clients data ecosystem.6-month contract to start, possible extensions. Hybrid working model, must be onsite 2 days per week in Burnaby office.Must Have Skills:2+ years of experience working in Data Warehouse...


  • Vancouver, British Columbia, B6B, British Columbia, Canada Inworld AI Full time

    Why Join InworldInworld is the best-funded startup in AI and games with a $500 million valuation and backing from top tier investors including Intel Capital, Microsoft’s M12 fund, Lightspeed Venture Partners, Section 32, BITKRAFT Ventures, Kleiner Perkins, Founders Fund, and First Spark Ventures.Inworld is the leading framework for building agentic...

  • Process Engineer

    3 weeks ago


    Vancouver, British Columbia, B6B, British Columbia, Canada Evident Full time

    Job Title: Process Engineer (SaaS & Manufacturing Experience Required)Location: Vancouver, BC | Work from OfficeJoin Evident – Transforming Dental Practices, Labs & Manufacturers with AI & AutomationAt Evident, we are redefining the dental industry through AI-powered solutions that make dental practices, laboratories, and manufacturers more efficient,...

  • Data Engineer

    2 weeks ago


    Vancouver, British Columbia, Canada Randstad Digital Full time

    Job Title: Data Engineer Group/Team: Engineering Desired Start Date: ASAP Contract Length: 6 months Possibility of Extension: Likely Location: Hybrid – Vancouver (3 days/week) Hours: 40 hours/week Status: Inc or T4 Role Overview We are seeking two Data Engineers (Engineer II level) to support key initiatives in data engineering and...