: Senior Data Engineer

About SecurityScorecard:

SecurityScorecard is an industry-leading cybersecurity company backed by Google, Sequoia, and Riverwood. Our mission is to make the world a safer place. We measure your and your vendors' cyber-health by assigning a security rating of "A" through "F" based on outside-in, non-intrusive data. Our Comprehensive security ratings, advanced data analytics, and actionable insights discover Third-Party Vulnerabilities & Security Gaps In Real-Time.
We are headquartered in NYC with over 200+ employees globally, raised over $110M USD, used by 1,000+ enterprise customers, and rating 1.5 million companies. We have created a new category of enterprise software, and our culture has helped us be recognized as one of the 10 hottest SaaS startups in NY for two years in a row.
Our vision is to create a new language for companies and their partners to communicate, understand, and improve each others security posture.

What you will do:

As a Senior Software Engineer on the Data Pipeline Platform team, you will help us scale, support, and build the next-generation platform for our data pipelines. The teams mission is to empower data scientists, software engineers, data engineers, and threat intelligence engineers accelerate the ingestion of new data sources and present the data in a meaningful way to our clients.

You will design and implement systems for ingesting, transforming, connecting, storing, and delivering data from a wide range of sources with varying levels of complexity and scale.  You will enable other engineers to deliver value rapidly with minimum duplication of effort. Automate the infrastructure supporting the data pipeline as code and deployments by improving CI/CD pipelines.  Monitor, troubleshoot, and improve the data platform to maintain stability and optimal performance.

Who you are:

  • Bachelor's degree or higher in a quantitative/technical field such as Computer Science, Engineering, Math
  • 6+ years of data pipeline software development experience
  • Exceptional skills in at least one high-level programming language (Scala, Java, Go, Python or equivalent)
  • Actively using and a strong understanding of big data technologies such as Kafka, Spark, Storm, Apache Flink, Databricks toolkit and Cassandra
  • Experience with Dataflow orchestration in Google Cloud Flow, Airflow, or Conductor
  • Experience with AWS services including EMR, S3, Redshift, and RDS
  • Excellent communication skills to collaborate with cross-functional partners and independently drive projects and decisions
  • Previous experience working in distributed teams. We are a remote-first company!
  • Located in the U.S. or Canada

Benefits:

  • We pay people well and give them challenging problems to solve.
  • World-class health benefits 
  • Stock options
  • 401K
  • You are always welcome to work from home
  • $3000 per year education fund
  • #1 Ranked Cybersecurity Analytics company in the word

SecurityScorecard embraces diversity. We believe that our team is strengthened through hiring and retaining employees with diverse backgrounds, skillsets, ideas, and perspectives. We make hiring decisions based upon merit and do not discriminate based on race, religion, national origin, gender identity or expression, sexual orientation, age, or marital, veteran, or disability status.

Full-time