Senior Database Python Software Developer

1 week ago

The Blue Mountains Ontario, CA Liquid Analytics Full time

**Job Title: Senior Database Python Software Developer**


**Location:** Blue Mountains, Ontario, Canada

**Remote Work:** You live where we work. You can come into our offices near Thornbury, Ontario, any day of the week as required.

**Job Type:** Full-Time


**About Us:**

At Liquid Analytics, we are committed to leveraging data-driven insights to enhance our longbow platform's capabilities. We are seeking a highly skilled and motivated **Senior Database Software Developer** to join our dynamic team. This role is critical in driving our streaming analytics initiatives using DuckDB and will be instrumental in shaping the future of our data processing workflows.


### **Key Responsibilities:**

  • Extensive experience building production-grade servers in Python.
  • Design, develop, and optimize complex SQL queries and Python macros for data transformations within the DuckDB framework.
  • Implement advanced data normalization and denormalization strategies to ensure data integrity and performance.
  • Perform data pipeline transformations and integrate statistical and ML methods into SQL and Python workflows.
  • Define data architecture and enhance the lb_duckdb_manager's functionality.
  • Ensure high performance and scalability of database operations through performance tuning and effective indexing strategies.
  • Manage changes that need to ripple across tables in the dataset, leveraging efficient update processes and monitoring tools.
  • Write platform-grade Python code while adhering to best practices and coding standards.
  • Mentor junior developers, sharing expertise in database design and SQL transformations.


### **Key Requirements:**

- **Expertise in SQL**: Proven experience in writing complex queries, performance tuning, and data transformations. Familiarity with advanced SQL features such as window functions, CTEs, and recursive queries.

- **Proficiency in Python**: Strong skills in Python for data processing, with experience in writing efficient and maintainable code.

- **Data Pipeline Transformations**: Experience in designing and implementing data pipelines, with a focus on streaming analytics.

- **Statistical and ML Methods**: Knowledge of applying statistical methods and machine learning techniques in SQL and Python.

- **DevOps Knowledge**: Experience in cloud development practices and CI/CD pipelines.

- **Business Logic Integration**: Ability to incorporate complex business logic into SQL transformations while maintaining transactional integrity and performance.

- **Analytical Mindset**: Strong problem-solving skills with the ability to analyze and optimize data workflows for performance and reliability.


### **Additional Skills and Knowledge:**

1. **Data Normalization**:

- Understanding the database normalization processes and the challenges associated with maintaining data integrity and performance during normalization.


2. **Data Denormalization**:

- Knowledge of when to denormalize for performance, understanding the trade-offs, redundancy, and data anomalies.


3. **Handling Data Types and Casting**:

- Experience with various data types, precision, and scale in numeric data and string manipulation.


4. **Performance Tuning**:

- Proficiency in reading execution plans, identifying performance bottlenecks, and implementing effective indexing strategies.


5. **Business Logic Integration**:

- Experience implementing complex business rules and ensuring transactional integrity across data transformations.


6. **Memory-Mapped Columnar Databases**:

- Familiarity with memory-mapped columnar databases and how memory mapping enhances performance and data accessibility.


7. **Managing Connections for Single-Process Analytics Databases**:

- Knowledge of memory management, connection management for read-write and read-only connections, and managing and publishing changes in a single-process analytics database like DuckDB.


### **Benefits:**

- Competitive salary and performance-based bonuses.

- Health, dental, and vision insurance.

- Flexible work hours and remote work opportunities.

- Professional development and continuous learning programs.

- Surrounded by nature in a beautiful environment with clean air and water.


### **How to Apply:**

You live where we work. You can come into our offices near Thornbury, Ontario, any day of the week as required.


Start by visiting our website and understanding the DuckDB database project.


You thrive in a fast-paced environment where delivering functional, user-centric features is key, and you’re comfortable with client interactions. Your development process begins with thorough requirement analysis and documentation, ensuring clarity and precision in every project. Experience with GitLab monorepos, build systems, and feature flagging is highly desirable.


Located within 40 minutes of Thornbury, Ontario, this role offers the opportunity to work in an area surrounded by nature. You can enjoy clean air and water in a beautiful environment. You are willing to locate yourself within 40 minutes of our offices so that you can come into the office at any time.

  • Senior Fullstack UI Developer

    1 week ago

    The Blue Mountains, Ontario, CA Liquid Analytics Full time

    Role SummaryBuild reactive database web applications Liquid Analytics is seeking a Senior JavaScript Svelte developer with at least 5 years of experience.You excel at creating pixel-perfect UI and have a deep understanding of colour, typography, layout, and user experience design.As a full-stack developer, you will own end-to-end features and build front-end...

  • AI GPU System Software Engineer

    2 weeks ago

    Markham, Ontario, I3P, CA Advanced Micro Devices inc. Full time

    WHAT YOU DO AT AMD CHANGES EVERYTHING We care deeply about transforming lives with AMD technology to enrich our industry, our communities, and the world. Our mission is to build great products that accelerate next-generation computing experiences – the building blocks for the data center, artificial intelligence, PCs, gaming and embedded. Underpinning our...

  • ML SDK Software Development Engineer

    1 month ago

    Markham, Ontario, I3P, CA Advanced Micro Devices inc. Full time

    WHAT YOU DO AT AMD CHANGES EVERYTHING We care deeply about transforming lives with AMD technology to enrich our industry, our communities, and the world. Our mission is to build great products that accelerate next-generation computing experiences – the building blocks for the data center, artificial intelligence, PCs, gaming and embedded. Underpinning our...

  • AI ML Software Design Engineer

    2 weeks ago

    Markham, Ontario, I3P, CA Advanced Micro Devices inc. Full time

    WHAT YOU DO AT AMD CHANGES EVERYTHINGWe care deeply about transforming lives with AMD technology to enrich our industry, our communities, and the world. Our mission is to build great products that accelerate next-generation computing experiences – the building blocks for the data center, artificial intelligence, PCs, gaming and embedded. Underpinning our...

  • Sr. Software System Designer

    3 months ago

    Markham, Ontario, I3P, CA Advanced Micro Devices inc. Full time

    WHAT YOU DO AT AMD CHANGES EVERYTHING We care deeply about transforming lives with AMD technology to enrich our industry, our communities, and the world. Our mission is to build great products that accelerate next-generation computing experiences – the building blocks for the data center, artificial intelligence, PCs, gaming and embedded. Underpinning our...

  • IO Diagnostic Software Development Engineer

    2 weeks ago

    Markham, Ontario, I3P, CA Advanced Micro Devices inc. Full time

    WHAT YOU DO AT AMD CHANGES EVERYTHINGWe care deeply about transforming lives with AMD technology to enrich our industry, our communities, and the world. Our mission is to build great products that accelerate next-generation computing experiences – the building blocks for the data center, artificial intelligence, PCs, gaming and embedded. Underpinning our...

  • Analog and Circuit Engineering intern

    1 month ago

    Markham, Ontario, I3P, CA Synopsys Full time

    Are you a dynamic individual with a passion for programming and a drive for excellence? We are seeking talented and enthusiastic Interns to join our R&D team, where you will be at the forefront of integrated circuit technology and workflow automation. This internship offers an incredible opportunity to gain hands-on experience in a fast-paced environment...

  • SMTS HIP Runtime Software Development Engineer

    3 months ago

    Markham, Ontario, I3P, CA Advanced Micro Devices inc. Full time

    WHAT YOU DO AT AMD CHANGES EVERYTHINGWe care deeply about transforming lives with AMD technology to enrich our industry, our communities, and the world. Our mission is to build great products that accelerate next-generation computing experiences – the building blocks for the data center, artificial intelligence, PCs, gaming and embedded. Underpinning our...

  • Audit Senior

    1 month ago

    North York, Ontario, A0F, CA HeadSource International Full time

    Audit Senior Location: North York, ON Position Type: Full-Time Experience Level: Mid-level Overview: Our client is seeking a highly motivated and detail-oriented Audit Senior to join their dynamic audit team. The ideal candidate will hold a CPA designation and have at least 3 years of audit experience in a public accounting firm, along with strong...

  • Senior Manager IT

    1 month ago

    Markham, Ontario, I3P, CA Advanced Micro Devices inc. Full time

    WHAT YOU DO AT AMD CHANGES EVERYTHINGWe care deeply about transforming lives with AMD technology to enrich our industry, our communities, and the world. Our mission is to build great products that accelerate next-generation computing experiences – the building blocks for the data center, artificial intelligence, PCs, gaming and embedded. Underpinning our...

  • Systems Design Engineer

    3 months ago

    Markham, Ontario, I3P, CA Advanced Micro Devices inc. Full time

    WHAT YOU DO AT AMD CHANGES EVERYTHING We care deeply about transforming lives with AMD technology to enrich our industry, our communities, and the world. Our mission is to build great products that accelerate next-generation computing experiences – the building blocks for the data center, artificial intelligence, PCs, gaming and embedded. Underpinning our...

  • Analog Design Methodology and Automation Engineer

    2 weeks ago

    Markham, Ontario, I3P, CA Synopsys Part time

    Job Title: R&D Integrated Circuit Technology InternshipIntroduction:We Are: Drive technology innovations that shape the way we live and connect. Our technology drives the Era of Pervasive Intelligence, where smart tech and AI are seamlessly woven into daily life. From self-driving cars and health-monitoring smartwatches to renewable energy systems that...

  • Intermediate/Senior Transportation Modeller

    3 months ago

    Markham, Ontario, I3P, CA PARSONS CORPORATION Full time

    In a world of possibilities, pursue one with endless opportunities. Imagine Next!When it comes to what you want in your career, if you can imagine it, you can do it at Parsons. Imagine a career working with intelligent, diverse people sharing a common quest. Imagine a workplace where you can be yourself. Where you can thrive. Where you can find your next,...

  • ASIC & Firmware Digital Verification Engineer Intern

    1 month ago

    Markham, Ontario, I3P, CA Synopsys Full time

    You Are:A highly motivated, innovative, and independent ASIC/firmware digital verification engineer intern. You thrive in a collaborative environment, working as part of a highly experienced mixed-signal design team. You are passionate about technology and eager to contribute to the verification of current and next-generation Backplane Ethernet, PCIe, SATA,...

  • BIOS Firmware Development Engineer

    2 weeks ago

    Markham, Ontario, I3P, CA Advanced Micro Devices inc. Full time

    WHAT YOU DO AT AMD CHANGES EVERYTHING We care deeply about transforming lives with AMD technology to enrich our industry, our communities, and the world. Our mission is to build great products that accelerate next-generation computing experiences – the building blocks for the data center, artificial intelligence, PCs, gaming and embedded. Underpinning our...

  • QA Engineer Co-OpLT

    1 month ago

    Markham, Ontario, I3P, CA Advanced Micro Devices inc. Full time

    WHAT YOU DO AT AMD CHANGES EVERYTHING We care deeply about transforming lives with AMD technology to enrich our industry, our communities, and the world. Our mission is to build great products that accelerate next-generation computing experiences – the building blocks for the data center, artificial intelligence, PCs, gaming and embedded. Underpinning our...

  • Silicon Physical Design Engineer

    3 months ago

    Markham, Ontario, I3P, CA Advanced Micro Devices inc. Full time

    WHAT YOU DO AT AMD CHANGES EVERYTHINGWe care deeply about transforming lives with AMD technology to enrich our industry, our communities, and the world. Our mission is to build great products that accelerate next-generation computing experiences – the building blocks for the data center, artificial intelligence, PCs, gaming and embedded. Underpinning our...

  • ASIC & Firmware Verification Engineer Intern

    1 month ago

    Markham, Ontario, I3P, CA Synopsys Full time

    We Are:At Synopsys, we drive the innovations that shape the way we live and connect. Our technology is central to the Era of Pervasive Intelligence, from self-driving cars to learning machines. We lead in chip design, verification, and IP integration, empowering the creation of high-performance silicon chips and software content. Join us to transform the...

  • Senior Recruiter

    2 weeks ago

    Markham, Ontario, I3P, CA PTAG Full time

    ['PTAG is a leading project management consulting firm specializing in providing high-quality project management, project controls, and project delivery services across various sectors, including energy, infrastructure, mining, and oil & gas. Our team is committed to delivering exceptional results for clients by combining innovative solutions with...

  • Sr. Staff SerDes Physical Implementation Engineer

    3 months ago

    Markham, Ontario, I3P, CA Synopsys Full time

    In this role, you will be responsible for the Physical Implementation of high speed interface IPs and test-chips, driving all aspects from RTL to GDS including timing and physical sign-off. You will work in close interaction and collaborative team work with multiple functional groups (front end digital, analog design and layout, CAD) and the product team.As...