Staff Data Engineer

Paradigm

Paradigm

Software Engineering, Data Science
Remote
Posted on Thursday, June 6, 2024

Join us as we rebuild the clinical research model and its integration into the clinical care model: it’s time for a new PARADIGM in healthcare and drug development.

We envision a world where clinical trials become an accessible care option for all patients, fully integrated into the standard clinical care continuum at scale. We are building a tech-enabled ecosystem to tackle inefficiencies in the current clinical research model. In today’s model, the vast majority of patients in the community are never offered access to clinical trial participation as a care option for their disease. Disproportionately, marginalized communities of patients with diverse racial, gender, and socioeconomic backgrounds are excluded from access and participation in clinical trials. Many of the barriers to scaled and widespread access to clinical trial participation is a function of barriers the current clinical trial system and care system creates at the community health care system and practice level. These barriers tend to be the result of a heavy labor burden and inefficient data collection process within the clinical trial framework. Our goal via the deployment of our end-to-end technology platform that is embedded in the provider workflow is to minimize these barriers and create efficiency at scale across the community healthcare ecosystem. In accomplishing this, patients will be given equitable access to clinical trials as a standard care option, which will accelerate trials for sponsors and alleviate the labor burden for providers. Our mission-driven group is dedicated to keeping the patient at the core of our work as we shift the healthcare landscape. We’re positioned to create lasting change in a system ready to be reimagined with a meaningful impact on patient lives.

Join us and bring your expertise, passion, creativity, and drive as we work together to increase access for all patients no matter the location creating an impactful difference in healthcare globally.

The Data Engineering team is building Paradigm’s platform for clinical care information, ingesting data from multiple sources, including Electronic Health Records, lab providers, Health Information Exchanges, and more. As Paradigm’s data needs evolve with an expanding population, research, and health system footprint, Data Engineering will scale its architecture to support enhanced parallel data processing.

Data Engineering enriches, harmonizes and makes data available for multiple consumers and product verticals, including:

  • AI & Data Science teams using this data to optimize and develop new classification models, define patient matching heuristics, answer feasibility queries for trial and research sites, and, ultimately, surface insights for clinical trial opportunities
  • Software application teams optimizing data for Paradigm’s Clinical Trial Matching workflows (matching patients to potential trials) and Study Conduct (capturing data once a trial has begun)

As a Staff Engineer on the Data team, you’ll partner closely with product teams and data consumers to improve the breadth, quality and completeness of our data, with a particular focus on technical architecture and roadmapping, data modeling, and ensuring appropriate data access in support of our product goals. You will also mentor and guide the growth of engineers on your team.

What you'll do:

  • Continuous improvement mindset and mentorship for your engineering team
  • Partner closely with product managers, data scientists and analysts, and engineering colleagues to distill complex business problems into efficient technical solutions
  • Craft the engineering vision and own the data models and toolchain for our data platform
  • Develop and iterate on data models optimized for the data team’s consumers use cases
  • Build and support robust batch and streaming pipelines
  • Build tools and processes to make data accessible across products and data consumers
  • Evolve the maturity of our monitoring systems and processes to improve visibility and failure detection in our infrastructure
  • Become a subject matter expert on our different datasets and tooling
  • Work with privacy & security to ensure we govern data responsibly
  • Support and advocate for a data platform appropriate to our evolving business profile

What you’ll bring:

  • You have experience driving technical projects, prioritizing work, identifying dependencies, facilitating technical decisions and cross-functional team discussions
  • Depth of expertise in SQL and data analysis skills
  • System design, data modeling and data workflow optimization
  • Coding in Python or other languages
  • Experience with ETL orchestration tools like Apache Airflow and Dagster
  • Data transformation tools like dbt or dataform
  • Experience with data warehouse DBs (such as BigQuery, Redshift, Snowflake, etc…)
  • Experience designing and implementing systems that are scalable, available, maintainable, and performant
  • 8+ years of experience in data engineering

At Paradigm, we are committed to providing equal employment opportunities to all qualified individuals. We believe in creating a diverse and inclusive workplace that values the contributions of every employee, regardless of their race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, disability, veteran status, or any other characteristic protected by law. We are an equal-opportunity employer and do not discriminate against any employee or applicant for employment based on any of the aforementioned factors. We encourage and welcome candidates from diverse backgrounds and perspectives to apply for our open positions. We strive to provide reasonable accommodations to qualified individuals with disabilities and to ensure that all employment decisions are based on job-related factors such as skills, experience, and qualifications.