Intersection: Data Engineer
10 Hudson Yards
New York, NY 10001

Video

Employee Testimonials

Who are we?

At Intersection, we are at the forefront of the smart cities revolution. Our mission is to improve daily life in cities and public spaces, with products that bridge the digital and physical worlds by delivering connectivity, information and content to enrich our everyday journeys and elevate the urban experience.

We pair our human-centered methodology with cutting-edge technology to design, develop, deliver, and maintain unique products and experiences in public spaces that deliver value to advertisers, cities, and consumers. Whether partnering with urban transit systems to revolutionize commuting and travel, with cities to transform how they connect with residents and visitors, or private developers to create unforgettable experiences in neighborhoods and districts, our solutions are scalable platforms on which our clients can build the future.

Intersection is backed by Alphabet through its urban technology company Sidewalk Labs.

What is the Role?

As a data engineer at Intersection, you will help to select and integrate tools and frameworks required to provide requested capabilities and facilitate access to data for business stakeholders. You will design and implement a secure data pipeline architecture, implement ETL processes that utilize the full line of AWS services, and monitor performance and advise about any necessary infrastructure changes to improve performance. Youll be an integral part of efforts to help define policies for the data engineering group, and implement security best practices across the whole data engineering architecture. You will report to the VP, Engineering.

Intersections platform is an ever-evolving mix of custom sensors, data analytics, 3rd-party services and solutions, and software written using: modern Python / Django, Javascript, React, Ansible and AWS Services.

Your First 30 Days:

  • Learn and understand Intersections corporate, departmental and team goals.
  • Develop a clear understanding of the product roadmap and current capabilities.
  • Become familiar with Intersections current tools and processes.

Your First 60 days:

  • Understand and get up to speed on the current Architecture.
  • Pair with team members on committed initiatives.
  • Work collaboratively with internal teams to deliver required data to business stakeholders.

Your First 90 Days:

  • Build and deploy new ETL/pipelines using AWS Lambdas and Step functions.
  • Interact with any API to build and deploy new ETL/pipelines using AWS Lambdas and Step functions.
  • Complete database tasks and administration as required.
  • Support snowflake and redshift data pipelines.
  • Define and implement data retention policies across systems.

You are awesome for the role because:

  • You have a proficient understanding of distributed computing principles.
  • You have production experience with tools such as Hadoop, AWS Kinesis, Kafka, AWS EMR, Snowflake and experience architecting pipelines with these tools.
  • You have experience with building stream-processing systems, using solutions such as Storm, Spark or Spark-Streaming.
  • You have experience integrating data from multiple data sources.
  • You have experience with NoSQL databases, such as HBase, Cassandra, MongoDB, DynamoDB, CosmosDB.
  • You have experience with RDBMs databases, with a strong preference for Postgresql, Redshift and Snowflake.
  • You have knowledge of various ETL techniques and frameworks, such as Flume.
  • You have a good understanding of Lambda Architecture, along with its advantages and drawbacks - Javascript and Python preferred.
  • You have the proven ability to take data analyst requirements and translate it to a data pipeline that meets the analyst's needs.
  • You have experience w/Tableau, Looker, and data report writing.
Full-time

Employee Testimonials

Tyler Green
Senior Software Engineer

Intersection is an amazing place to work! Building software used by riders of many of the country's largest transit systems is extremely rewarding. And there's nothing like debugging your own code running on a train platform on your commute home! Our Smart Cities Engineering team is filled with passionate people working to bring revolutionary products to the streets and people of our cities, all while supporting each other and our growth as engineers.

Leah Jacobs
National Account Executive

Working at Intersection has given me the ability to grow both personally and professionally as my career has developed. There are always new ideas, challenges and opportunities to go after so each day is truly a new adventure. While I love what I do - I must admit that the people & culture here at Intersection are what keep me grounded and loyal. The passion and support from each team are the reasons why we continue to excel and become market leaders in our industry.

Kavita Chaudhry
Senior Software Engineer

From the people I work with to the tech and code I develop, I love being an Engineer at Intersection. I love the team I work with - every single one of us brings something unique to the table. I love the diversity of projects I work on - I am not confined to just one language or one side of the tech stack. On Monday, I could be working in Python or Go or Scala, but on Friday I might be working in Javascript. I also love the amount of input we, Engineers, have on the projects we work on -  we can pitch an idea and there's a solid chance that we can make that project or idea a reality. All of these things - combined with our do good mission - make Intersection an amazing and exciting place to work!

Andrew Albright
Partner Manager, Link

I love my job at Intersection! Every day I step into the office, I get to spend my day working with talented and passionate people from a diverse set of disciplines. Our work providing free wireless internet to millions of people across the world speaks volumes about Intersection's values as a company. Not only am I engaged in my work and given responsibility in my role, but I am happy knowing that I work with a team that is providing a crucial service in helping to close the digital divide in New York, London, and beyond.