Principal Architect, Data Engineer

2 weeks ago


Canada Lovelytics, LLC Full time

We are seeking an accomplished Principal Consultant with specialized expertise in delivering strategic Databricks and data engineering solutions for our clients at Lovelytics. As a pivotal member of our team, you will serve as a data and analytics solution architect, leading technical engagement and architecture initiatives encompassing data warehousing, ETL development, data integrations, and data modeling.

Location: This role is open to remote candidates in the following states: MD, DC, CA, IL, IA, IN, MA, ME, NC, TX, TN, GA, CO, NY, NJ, VA, FL, PA, OH, ORwith a preference for candidates located near one of our hubs of DC, NY, Austin, Chicago, Nashville, or Toronto, Canada.

Primary Responsibilities:

  • Design end-to-end data pipelines leveraging Databricks for ETL, streaming, and batch processing.
  • Architect data lakes and warehouses on Databricks, ensuring scalability, reliability, and performance.
  • Collaborate with stakeholders and other capability team members to translate business requirements into technical specifications and scalable solutions.
  • Implement best practices for data governance, security, and optimization within the Databricks environment.
  • Collaborate with Technical Directors to identify market trends, implement internal initiatives, and contribute thought leadership through blogs and innovative solutions.
  • Applydeep technical knowledge to address client challenges and expand business opportunities, and attimes, engage in client-facing pre-sales and pursuit activities.
  • Manage projects, ensuring milestones are achieved within set timelines and budgetary constraints.
  • Provide technical guidance and support across various project facets, from data integration to troubleshooting.

Required Skills & Experience:

  • Bachelor's degree in Computer Science or related field.
  • 8+ years of data engineering experience within cloud-based analytics architectures, with at least 4 years in a traditional consulting environment and role.
  • Proven experience as a Solution Architect or Data Engineer, with a focus on Databricks.
  • Strong proficiency in building and optimizing big data pipelines using Databricks Delta and Apache Spark.
  • Solid understanding of cloud platforms (Azure, AWS, or GCP) and their integration with Databricks.
  • Expertise in SQL, Python, or Scala for data manipulation and analysis.
  • Familiarity with Machine Learning model development or ML Ops is advantageous.
  • Excellent communication skills, crucial for effective client interaction and management.
  • Relevant certifications such as Databricks Data Engineer Professional and Databricks Machine Learning Professional are desirable.

What We Offer:

  • Exciting projects with diverse clients across various industries globally.
  • Collaborative environment fostering rapid skill development and innovation.
  • Opportunity to work alongside seasoned data engineers and grow professionally.
  • Encouragement to challenge norms, develop new technologies, and refine methodologies.
  • A vibrant, diverse team of data enthusiasts, experience seekers, and entrepreneurial minds dedicated to continuous improvement.

Lovelytics is an Equal Opportunity Employer. This means you don’t have to worry about whether your application process will be fair. We consider all applicants without regard to race, color, religion, age, ancestry, ethnicity, gender, gender identity, gender expression, sexual orientation, veteran status, or disability.

#J-18808-Ljbffr

  • Canada Bolt Financial Inc Full time

    We're searching for a Principal Software Engineer to join our engineering leadership team and play a crucial role in shaping our technological foundation. You will work directly with product and engineering leaders in helping to shape and define market-leading solutions in the face of ambiguous requirements. You will have influence and oversight over...


  • Canada Wysdom Full time

    They say you only get one chance to make a great first impression. We exist to help our clients make a great first impression with their customers – over and over again! It will power everything from self-driving cars to gadgets around your home. Wysdom creates and manages the smartest virtual agents on behalf of our clients. Wysdom is a fast growing,...


  • , , Canada OpsGuru Full time

    Position OpsGuru is a global engineering and consulting group. We are experts in the container ecosystem, data processing and analytics, and cloud-native technologies. Our team is formed by network, data, security, DevOps specialists, and application developers. OpsGuru empowers customers with technology to solve their business problems and provides the...


  • Canada OpsGuru Full time

    Position OpsGuru is a global engineering and consulting group. We are experts in the container ecosystem, data processing and analytics, and cloud-native technologies. Our team is formed by network, data, security, DevOps specialists, and application developers. OpsGuru empowers customers with technology to solve their business problems and provides the...


  • Canada Bolt Financial Inc Full time

    We're searching for a Principal Software Engineer to join our engineering leadership team and play a crucial role in shaping our technological foundation. This is not your typical architect role - you'll be a hands-on leader with the experience to guide multiple teams. You will work directly with product and engineering leaders in helping to shape...

  • Data Architect

    1 week ago


    Canada Dlytica Inc Full time

    Are you a candidate who is motivated to optimize the Architecture with new upcoming interesting features and tools in the cloud? And you have a great understanding and Experience in building Data Pipelines, Data Warehouse Models, and Governance of data like Security, privacy, compliance, etc. Roles and Responsibilities Translating business requirements...


  • , , Canada TransUnion Full time

    TransUnion's Job Applicant Privacy Notice What We'll Bring: At TransUnion, we are dedicated to finding ways information can be used to help people make better and smarter decisions. As a trusted provider of global information solutions, our mission is to help people around the world access the opportunities that lead to a higher quality of life, by...


  • Canada TransUnion Full time

    TransUnion's Job Applicant Privacy Notice What We'll Bring: At TransUnion, we are dedicated to finding ways information can be used to help people make better and smarter decisions. As a trusted provider of global information solutions, our mission is to help people around the world access the opportunities that lead to a higher quality of life, by...

  • Lead Data Architect

    2 weeks ago


    Canada Safety Cybersecurity Full time

    1 month ago Be among the first 25 applicants We are seeking a highly skilled and experienced Lead Data Architect to drive the development of our new data collection, processing, and analysis system. This system is focused on open source package and vulnerability data within the cybersecurity domain, specifically targeting Python, JavaScript and Java...

  • Data Engineer

    3 weeks ago


    Canada Wysdom Full time

    They say you only get one chance to make a great first impression. At Wysdom we’re here to change that. We exist to help our clients make a great first impression with their customers – over and over again! Conversation is the new user interface (UI). It will power everything from self-driving cars to gadgets around your home. For a conversational UI to...

  • Data Engineer

    3 days ago


    Canada Affinity Group Full time

    Job Description: We are looking for Contract Data Engineers and Data Architects who are certified in Snowflake ( SnowPro or higher). We are seeking experienced and highly skilled Data Engineers and Data Architects to join our dynamic team on a contract basis. The initial contract duration is 6-12 months with the possibility of extensions based on...


  • Canada Dlytica Inc Full time

    Are you a candidate who is motivated to optimize the Architecture with new upcoming interesting features and tools in the cloud? And you have a great understanding and Experience in building Data Pipelines, Data Warehouse Models, and Governance of data like Security, privacy, compliance, etc. Translating business requirements into technical specifications,...

  • Data Engineer

    3 days ago


    Canada Affinity Group Full time

    Job Description: We are looking for Contract Data Engineers and Data Architects who are certified in Snowflake ( SnowPro or higher). We are seeking experienced and highly skilled Data Engineers and Data Architects to join our dynamic team on a contract basis. The initial contract duration is 6-12 months with the possibility of extensions based on...

  • Data Engineer

    3 weeks ago


    Canada Koho Financial Inc Full time

    We’re looking for a Data Engineer to join our team for a remote role based in Canada. As our newest Data Engineer, you would bring your database design sense and meticulous standards for clean data to the table. More than just understanding the strategic importance of data in a financial context, you’re eager to roll up your sleeves and build the...


  • Canada Inspro Technologies Corporation Full time

    Our Purpose At Majesco, we believe in connecting people and business to Insurance in ways that are Innovative, Hyper-Relevant, Compelling and Personal. We bring together the brightest minds to build the future of Insurance; a world where Insurance makes life and business easier, more connected, and better protected. Majesco is seeking an Architect for our...

  • Lead Data Architect

    2 weeks ago


    Canada Safety Cybersecurity Full time

    1 month ago Be among the first 25 applicants We are seeking a highly skilled and experienced Lead Data Architect to drive the development of our new data collection, processing, and analysis system. This system is focused on open source package and vulnerability data within the cybersecurity domain, specifically targeting Python, JavaScript and Java...

  • Sr Data Engineer

    4 days ago


    Canada NTT Data Vertex Software Inc. Full time

    Apply for Sr Data Engineer, Career Progress Consultants in Canada for Year of Experience on

  • Sr Data Engineer

    4 days ago


    Canada NTT Data Vertex Software Inc. Full time

    Apply for Sr Data Engineer, Career Progress Consultants in Canada for 8 - 11 Year of Experience on TimesJobs.com.

  • Data Engineer

    3 weeks ago


    Canada Intelliswift Software Full time

    Job Title: Data Engineer Location: Anywhere in Canada (100% remote)Duration: 12+ monthsPosition Overview:We are seeking a highly skilled and motivated Data Engineer to join our team. The ideal candidate will have a strong background in data engineering, with expertise in DataBricks and Data Lake technologies. This role will involve designing, building, and...

  • Data Engineer

    3 weeks ago


    Canada Intelliswift Software Full time

    Job Title: Data Engineer Location: Anywhere in Canada (100% remote)Duration: 12+ monthsPosition Overview:We are seeking a highly skilled and motivated Data Engineer to join our team. The ideal candidate will have a strong background in data engineering, with expertise in DataBricks and Data Lake technologies. This role will involve designing, building, and...