Data Engineer – Arthur

Job Description

At Arthur, we are building the first platform for Responsible AI and work with leaders in finance, self-driving transportation, and other leading-AI industries. We are backed by the best investors in enterprise software and are growing the top startup team in enterprise tech. We are led by industry veterans with deep expertise in ML. We are looking for a driven Data Engineer to join our diverse and collaborative team!

#### As a Data Engineer, you will:
• Design & build a high-throughput SaaS platform with particular emphasis on data engineering components.
• Be responsible for production delivery of your components , including integration & coordination with your teammates responsible for the user-facing web application, CICD pipelines, and SRE infrastructure.
• Be forward-thinking in designing for future petabyte-scale, ensuring a performant & resilient architecture.
• Exhibit continuous curiosity in understanding emerging technology that could solve our challenges.
• Mentor others on best data engineering practices & guide decision-makin.

#### Qualifications
• 3+ years software engineering experience on a SaaS platform with emphasis on large-scale data systems.
• Experience building large-scale data systems using distributed file storage technologies such as hdfs and s3 and distributed processing frameworks such as Spark, EMR, and HDFS.
• Experience with event processing and streaming data technologies including message queues such as Kafka and stream processors such as Spark streaming, Storm, Kinesis, etc.
• Experience with multiple RDBMS & NoSql technologies.
• Proficiency with Python (preferred) or other commonly used data processing languages such as Java or Scala.
• Understanding of multi-tenant platforms, best practices for managing multiple organizations on a shared platform, providing secure & controlled access to data, and role-based access control (RBAC).
• Experience working with cloud environments such as AWS and GCP.
• CS (preferred) or other technical degree, or equivalent practical experience.

#### Preferences
• 1+ year experience as a technical lead in data engineering.
• Experience with machine learning & AI and related tools such as Airflow, Tensorflow, and Sci-kit learn.
• Experience with analytics or data visualization architectures Experience with on-prem deployment architectures.
• Experience running a 24×7 SaaS platform with an SLA.

#### We offer
• Working with a small, fast-growing team, lots of opportunity to take ownership and run with projects.
• The opportunity to get in on the ground floor of a rapidly growing startup.
• Generous equity
• A culture that empowers great people to accomplish great things.
• Full benefits package.