Staff Software Engineer- Developer Experience

Join us as a Staff Software Engineer- Developer Experience to design intuitive Python libraries, APIs, and tools that make building and consuming data products seamless for developers.

The company

The future of data lies in decentralization, and the concept of a data mesh is the proven approach for implementing this at Enterprise scale. We’re here to make it a reality. Nextdata OS is a data-mesh-native platform built to meet the challenge of decentralizing data at scale. We are inventing a new way for developers to work with data and share it responsibly via data product containers.

Our vision is to build a world where AI/ML and analytics are powered by decentralized, responsible, and equitable data ownership, across boundaries of organizations, technology, and most importantly boundaries of trust.

Our purpose is to change the experience of creating, sharing, discovering, and using data forever, to be connected, fast, and fair based on data mesh principles.

Our technology is designed to empower data developers, users and owners with a delightful experience where data products are a first-class primitive, with trust built-in.

We are here to accept the reality that the world of data is complex and messy; data models are out-of-date the moment they are created; data is owned across trust boundaries; data is stored on different platforms; data is used in many different modes and most importantly data can't protect itself. We recognize that past approaches to tackle these complexities with centralized data collection, modeling and governance are ineffective at best and pathologically unfair at worst. Our mission is to reimagine the world of data with you.

The role

As a Staff Software Engineer- Developer Experience, you will play a pivotal role in shaping how developers interact with Nextdata OS, making it seamless and intuitive to build and consume data products. You will design and build Python-centric APIs, libraries, and tools that abstract the complexity of data product development while enabling powerful integrations with technologies like Spark, Flink, and pandas. Your work will extend to optimizing notebook environments like Jupyter to enhance workflows for data engineers, data scientists, and ML practitioners, empowering them to create high-quality, decentralized data products efficiently.

  • Design Developer Tools: Build intuitive Python libraries, APIs, and frameworks that simplify the creation and consumption of data products on Nextdata OS.
  • Optimize Notebook Environments: Enhance and extend Jupyter notebooks and similar tools to provide a seamless, developer-friendly experience for data engineers and scientists.
  • Build Showcase Data Products: Collaborate with internal teams to create data products that demonstrate best practices and highlight the capabilities of Nextdata OS.
  • Abstract Complexity: Develop reusable abstractions and workflows to support a wide range of technologies, including Spark, Flink, and pandas, ensuring platform and language agnosticism.
  • Collaborate Across Teams: Partner with data engineers, data scientists, and product teams to understand developer needs and refine the platform experience.
  • Lead Open Source Contributions: Contribute to and collaborate with the open-source community to ensure tools and libraries meet the highest standards of usability and adoption.
  • Enable Streaming Workflows: Work on enabling and optimizing streaming data products, integrating with technologies like Spark Streaming and Flink.
  • Document and Advocate: Create clear documentation, tutorials, and best practices to empower developers to effectively use Nextdata OS.
  • Iterate with Feedback: Continuously improve tools and workflows based on feedback from internal and external developers to ensure a delightful experience.
  • Champion Developer Experience: Advocate for user-centric design and workflows that prioritize efficiency, clarity, and simplicity for developers.

You Are The Right Fit If You Have

  • 10+ Years of Experience: Proven track record in software engineering with a focus on developer experience, data engineering, or data science, including building tools and frameworks for technical users.
  • Expert Python Skills: Deep understanding of Python, including advanced features like decorators, context managers, metaprogramming, and performance optimization. Experience building libraries and frameworks used by other developers is essential.
  • ML and Data Engineering Expertise: Hands-on experience with machine learning workflows and data engineering pipelines using tools such as PySpark, pandas, and Flink. Familiarity with streaming data technologies is a strong plus.
  • Notebook Development Experience: Significant experience with Jupyter notebooks or similar tools, including customizing and extending them to support complex developer workflows.
  • Open Source Contributions: Demonstrated history of contributing to or leading open-source projects, particularly in the Python ecosystem, with an emphasis on developer-focused tools.
  • Developer Experience Design: Proven ability to design intuitive and seamless developer workflows, tools, and APIs that abstract complexity while maintaining flexibility.
  • Multi-Language Environments: Familiarity with creating tools and frameworks that support polyglot environments and integrate with diverse technology stacks.
  • Distributed Systems Knowledge: Experience building and working with systems at scale, including familiarity with cloud-native technologies and data platforms like Spark, Snowflake, and Databricks.
  • Strong Collaboration Skills: Ability to collaborate across teams and functions, working closely with data engineers, scientists, and platform developers to deliver impactful tools and features.
  • Startup Experience: Comfortable in a fast-paced, early-stage startup environment, with a hands-on approach to problem-solving and a proactive mindset.

Our benefits

  • We offer a competitive salary and equity, giving you ownership in the company’s future.
  • Premium health, vision, and dental insurance coverage for you and your dependents.
  • Unlimited paid time off for flexibility and balance.
  • $2,000 for your home workspace setup and a company laptop to get started.

Apply with us

Similar Roles

View all roles

Founding Principal Software Engineer

As a Founding Principal Software Engineer, you will help build out the next generation data platform to support decentralized analytical and ML workloads, which includes data product containers and the data product container runtime.
See Role

Principal Infrastructure Engineer

Join us as a Principal Infrastructure Engineer to design and deploy scalable, secure infrastructure for Nextdata OS across multi-cloud environments. Lead CI/CD automation, optimize deployments, and drive the future of decentralized data with cutting-edge Kubernetes-native technologies.
See Role

QA Engineer

Join us as a Quality Assurance Engineer to elevate Nextdata OS by developing robust testing infrastructures, optimizing CI/CD pipelines, and rigorously evaluating Kubernetes-based systems.
See Role

Senior Rust Systems Engineer

Own design and implementation of core components of the Nextdata OS and shape the future of data mesh adoption.
See Role

Technical Solutions Engineer

Join Nextdata as a Solutions Engineer to develop and deploy innovative data products on Nextdata OS, collaborate with customers to transform their business needs into impactful solutions, and drive the adoption of data mesh principles.
See Role

Let’s change the way data is created, shared, and used, forever.

Nextdata is hiring. We’re looking for pragmatic, empathetic problem-solvers who understand the needs of tomorrow and dare to challenge the ways of the past.

An error occurred while processing your request. Please check the inputted data and try again.
This is a success message.

Let’s change the way data is created, shared, and used, forever.

Get in touch

Jobs

No items found.