Python Pyspark Data Engineer
2 days ago
Winnipeg MB, Winnipeg Census Division, MB; Manitoba, Canada
Lancesoft
Full-time
Free with email or Google
Save this job and keep your search organized
Create a free account to save jobs, create alerts and return to this listing from your dashboard.
Free with email or Google
By continuing, you agree to our Terms & Privacy Policy.
Build data pipelines with Python, PySpark, and Snowflake while transforming large-scale datasets through distributed processing. Apply deep SQL expertise to reliable engineering work.
This Data Engineer role focuses on Python programming, PySpark transformations, and Snowflake development. You will create ETL and ELT solutions, integrate data, and support migration and orchestration. The work also involves data warehousing, schema design, validation, and error handling.
Key Responsibilities
Develop data processing solutions using Python librariesTransform large-scale datasets with PySparkBuild ETL and ELT data integration pipelinesDesign Snowflake tasks, streams, stages, and Snowpipe workflowsImplement incremental loads, validation, and error handlingRequirements:
Strong Python experience with Pandas and NumPyStrong PySpark experience for distributed data processingExtensive SQL knowledge, including joins and window functionsHands-on ETL, migration, and pipeline orchestration experienceExperience with Git, debugging, and code deploymentUse Python, PySpark, SQL, and Snowflake expertise to engineer scalable data processing and integration pipelines.
#J-18808-Ljbffr
This Data Engineer role focuses on Python programming, PySpark transformations, and Snowflake development. You will create ETL and ELT solutions, integrate data, and support migration and orchestration. The work also involves data warehousing, schema design, validation, and error handling.
Key Responsibilities
Develop data processing solutions using Python librariesTransform large-scale datasets with PySparkBuild ETL and ELT data integration pipelinesDesign Snowflake tasks, streams, stages, and Snowpipe workflowsImplement incremental loads, validation, and error handlingRequirements:
Strong Python experience with Pandas and NumPyStrong PySpark experience for distributed data processingExtensive SQL knowledge, including joins and window functionsHands-on ETL, migration, and pipeline orchestration experienceExperience with Git, debugging, and code deploymentUse Python, PySpark, SQL, and Snowflake expertise to engineer scalable data processing and integration pipelines.
#J-18808-Ljbffr