Data Engineer – GCP

3 weeks ago


Old Toronto, Canada ProViso Staffing Full time
Story Behind the Need:

• Business group: Enterprise Platform Architecture & Enablement – building data pipelines from end to end
• Project: Initiative working with an external vendor (fraud and know your customer technology) – ensuring data is properly ingested, structured; work in coordinating with fraud, digital teams and business partners to ensure data is effectively shaped-stage: through proof of concept, current coordination with vendor partners and ensuring their technologies align to ours, early stages and ramping up

Candidate Value Proposition:

• The successful candidate will have the opportunity to gain exposure to advanced technologies in big data analytics, such as Spark, GCP, Kafka, MongoDB; work in a top 5 Canadian Bank.
• An inclusive and collaborative working environment that encourages creativity, curiosity, and celebrate success
• Exposure to different business lines where analytics techniques are being applied
• Assignment in hands-on practical projects which provide an opportunity to gain new knowledge and develop skills

Typical Day in Role:

• Collaborate with business lines and other stakeholders and identify opportunities to drive business value by leveraging data engineer.
• Efficiently handle large volumes of structured and unstructured data through ingestion, modeling, transformation, and storage across diverse data stores. Leverage distributed computing tools (e.g., Spark, Cloud) for analysis, data mining, and modeling
• Collaborate with operation, and other analytics teams to deploy models and automate pipelines/ workflows in production across different channels and platforms
• Work with the team to design the project architecture and road map.
• Create and apply model and algorithm testing strategies to measure the effectiveness of models, and make ongoing changes.
• Prepare detailed documentation to outline data sources, models, and algorithms used and developed.
• Present results to business line stakeholders and help implement real world data-driven changes.

Candidate Requirements/Must Have Skills:

• 10+ years of progressive experience as Data Engineer, Software Developer, or similar technical roles.
• 5+ years’ experience with SQL/NOSQL and relational databases technologies/concepts for both querying/manipulating datasets and managing/controlling databases.
• 3+ years’ experience with Google Cloud Platform about Data Ingesting and on-prem to cloud environment data replication.
• 5+ years’ combined experience programming in Python or equivalent languages (Scala, Java), and tools such as Spark, Airflow (please list which)

Nice-To-Have Skills:

• Experience with DBT (Data Building Tool)
• Experience in creating Docker images
• Experience/knowledge of MongoDB
• Experience from banking/financial services

Soft Skills Required:

• Excellent written, verbal, and interpersonal skills for executive level communication and collaboration
• Able to work in a fast-paced, constantly evolving environment and manage multiple priorities.
• Pragmatic and capable of solving complex issues.
• Experience working with a variety of cross-functional teams

Education:

• Bachelor’s Degree or equivalent in in Computer Science, Engineering, or relevant field.

Best VS. Average Candidate:

• GCP, Python and Spark experience best for programming

Candidate Review & Selection:

• MS Teams Video Interviews – 1st – HM interview round – 45 min Max
• 2nd – Panel Technical round – 45 min max – potential exercise/case study component

Job Details

11846

Contract

6 months

Toronto

#J-18808-Ljbffr

  • Toronto, Canada COGNITO INC Full time

    We have multiple roles for Data Engineer. 1. Data Engineer ML, 2. GCP Data Engineer. Please see the description below. Data Engineer/MLOps Location: Toronto, ON Job Description: Mandate Skills: MLOPS, Azure Data bricks, Visualization Experience, SQL, Python Job Description: Minimum 5 years of experience in Data Engineering role that involves Analyzing,...


  • Toronto, Canada COGNITO INC Full time

    We have multiple roles for Data Engineer. 1. Data Engineer ML, 2. GCP Data Engineer. Please see the description below.Data Engineer/MLOpsLocation: Toronto, ONJob Description:Mandate Skills: MLOPS, Azure Data bricks, Visualization Experience, SQL, PythonJob Description: Minimum 5 years of experience in Data Engineering role that involves Analyzing, organizing...


  • Toronto, Canada COGNITO INC Full time

    We have multiple roles for Data Engineer. 1. Data Engineer ML, 2. GCP Data Engineer. Please see the description below. Data Engineer/MLOps Location: Toronto, ON Job Description: Mandate Skills: MLOPS, Azure Data bricks, Visualization Experience, SQL, Python Job Description: Minimum 5 years of experience in Data Engineering role that involves Analyzing,...


  • Toronto, Canada COGNITO INC Full time

    We have multiple roles for Data Engineer. 1. Data Engineer ML, 2. GCP Data Engineer. Please see the description below.Data Engineer/MLOpsLocation: Toronto, ONJob Description:Mandate Skills: MLOPS, Azure Data bricks, Visualization Experience, SQL, PythonJob Description: Minimum 5 years of experience in Data Engineering role that involves Analyzing, organizing...

  • Data Engineer – GCP

    4 weeks ago


    Old Toronto, Canada ProViso Staffing Full time

    Story Behind the Need: • Business group: Enterprise Platform Architecture & Enablement – building data pipelines from end to end• Project: Initiative working with an external vendor (fraud and know your customer technology) – ensuring data is properly ingested, structured; work in coordinating with fraud, digital teams and business partners to...


  • Toronto, Canada Viva Tech Solutions Full time

    10+ years of experience in data engineering, performance optimization for large OLTP applications with a minimum of 4+ years of working experience as Google Cloud Platform (GCP) developerExperience with the primary managed data services within GCP, including DataProc, Dataflow, BigQuery/DBT, Cloud Spanner, Cloud SQL, Cloud Pub/Sub etc.Experience with Google...


  • Toronto, Canada Viva Tech Solutions Full time

    10+ years of experience in data engineering, performance optimization for large OLTP applications with a minimum of 4+ years of working experience as Google Cloud Platform (GCP) developerExperience with the primary managed data services within GCP, including DataProc, Dataflow, BigQuery/DBT, Cloud Spanner, Cloud SQL, Cloud Pub/Sub etc.Experience with Google...


  • Toronto, Canada Viva Tech Solutions Full time

    10+ years of experience in data engineering, performance optimization for large OLTP applications with a minimum of 4+ years of working experience as Google Cloud Platform (GCP) developerExperience with the primary managed data services within GCP, including DataProc, Dataflow, BigQuery/DBT, Cloud Spanner, Cloud SQL, Cloud Pub/Sub etc.Experience with Google...


  • Toronto, Canada Viva Tech Solutions Full time

    10+ years of experience in data engineering, performance optimization for large OLTP applications with a minimum of 4+ years of working experience as Google Cloud Platform (GCP) developer Experience with the primary managed data services within GCP, including DataProc, Dataflow, BigQuery/DBT, Cloud Spanner, Cloud SQL, Cloud Pub/Sub etc. Experience with...


  • Toronto, Canada Viva Tech Solutions Full time

    10+ years of experience in data engineering, performance optimization for large OLTP applications with a minimum of 4+ years of working experience as Google Cloud Platform (GCP) developerExperience with the primary managed data services within GCP, including DataProc, Dataflow, BigQuery/DBT, Cloud Spanner, Cloud SQL, Cloud Pub/Sub etc.Experience with Google...


  • Old Toronto, Canada Nexus Systems Group Inc. Full time

    Typical Day in Role: • Design and implement secure, scalable, and robust cloud infrastructure solutions using GCP to support application development and deployment needs. • Migrate existing on-premises applications and services to GCP, ensuring minimal downtime and optimal performance. • Monitor cloud environments, analyze performance metrics, and...


  • Old Toronto, Canada Nexus Systems Group Inc. Full time

    Typical Day in Role: • Design and implement secure, scalable, and robust cloud infrastructure solutions using GCP to support application development and deployment needs. • Migrate existing on-premises applications and services to GCP, ensuring minimal downtime and optimal performance. • Monitor cloud environments, analyze performance metrics, and...


  • Old Toronto, Canada Nexus Systems Group Inc. Full time

    Typical Day in Role: • Design and implement secure, scalable, and robust cloud infrastructure solutions using GCP to support application development and deployment needs. • Migrate existing on-premises applications and services to GCP, ensuring minimal downtime and optimal performance. • Monitor cloud environments, analyze performance metrics, and...

  • Cloud Engineer

    1 week ago


    Old Toronto, Canada Tundra Technical Solutions Inc. Full time

    PurposeWe are seeking a dedicated and experienced Cloud Engineer with specialized knowledge in Google Cloud Platform (GCP) to join our Cloud Operations team. This role involves working on critical cloud infrastructure projects, ensuring optimal architecture and performance, and supporting our development teams in creating innovative applications and...

  • Cloud Engineer

    1 week ago


    Old Toronto, Canada Tundra Technical Solutions Inc. Full time

    PurposeWe are seeking a dedicated and experienced Cloud Engineer with specialized knowledge in Google Cloud Platform (GCP) to join our Cloud Operations team. This role involves working on critical cloud infrastructure projects, ensuring optimal architecture and performance, and supporting our development teams in creating innovative applications and...

  • Cloud Engineer

    1 week ago


    Old Toronto, Canada Tundra Technical Solutions Inc. Full time

    PurposeWe are seeking a dedicated and experienced Cloud Engineer with specialized knowledge in Google Cloud Platform (GCP) to join our Cloud Operations team. This role involves working on critical cloud infrastructure projects, ensuring optimal architecture and performance, and supporting our development teams in creating innovative applications and...

  • GCP Data Engineer

    2 weeks ago


    Toronto, Canada Diamondpick Full time

    Job Title: GCP Data EngineerLocation: Toronto, ON (Hybrid)Job Description:Required Skills:5+ years of hands-on technical working experience in the use of Azure Cloud and Google Cloud Platform for services such as:Container Orchestration (Google Kubernetes Engine, Azure Kubernetes Services, App Service Environment)Container Registry (Google Container...

  • GCP Data Engineer

    2 weeks ago


    Toronto, Canada Diamondpick Full time

    Job Title: GCP Data Engineer Location: Toronto, ON (Hybrid) Job Description: Required Skills: 5+ years of hands-on technical working experience in the use of Azure Cloud and Google Cloud Platform for services such as: Container Orchestration (Google Kubernetes Engine, Azure Kubernetes Services, App Service Environment) Container Registry (Google...

  • GCP Data Engineer

    2 weeks ago


    Toronto, Canada Diamondpick Full time

    Job Title: GCP Data EngineerLocation: Toronto, ON (Hybrid)Job Description:Required Skills:5+ years of hands-on technical working experience in the use of Azure Cloud and Google Cloud Platform for services such as:Container Orchestration (Google Kubernetes Engine, Azure Kubernetes Services, App Service Environment)Container Registry (Google Container...

  • Data Engineer

    3 weeks ago


    Toronto, ON, Canada ProViso Staffing Full time

    Story Behind the Need: • Business group: Enterprise Platform Architecture & Enablement – building data pipelines from end to end • Project: Initiative working with an external vendor (fraud and know your customer technology) – ensuring data is properly ingested, structured; work in coordinating with fraud, digital teams and business partners to...