Pluralsight: Data Engineer
60 State Street, Suite 800
Boston, MA 02109

Employee Testimonials

Ellen Thompson Pluralsight

Video

Job Description

Our Data Engineering team builds and maintains a secure, scalable, flexible and user-friendly analytics hub that allows us to make informed and data-driven decisions. They also construct and curate business-critical data sets that allow us to realize the value of all the data we collect.  

A Data Engineer utilizes a multidisciplinary approach to providing ETL solutions for the business, combining technical, analytical, and domain knowledge. The perfect applicant for this role has strong development skills, experience transforming and profiling data to determine risks associated with proposed analytics solutions, a willingness to continually interface with analysts in order to determine an optimal approach, and an eagerness to explore data sources to understand the availability, utility, and integrity of our data.

What you'll own:

Data pipeline / ETL development:

  • Building and enhancing data curation pipelines using tools like SQL, Python, Glue, Spark and other AWS technologies
  • Focus on data curation on top of datalake data to produce trusted datasets for analytics teams

Data Curation:

  • Processing and cleansing data from a variety of sources to transform collected data into an accessible and curated state for Analysts and Data Scientists
  • Migrating self-serve data pipeline to centrally managed ETL pipelines
  • Advanced SQL development and performance tuning 
  • Some exposure to Spark, Glue or other distributed processing frameworks helpful
  • Work with business data stewards & analytics team to research and identify data quality issues to be resolved in the curation process

Data Modeling:

  • Design and build master dimensions to support analytic data requirements
  • Replacing legacy data structures with new datasets sourced from streaming data feeds from the core product and other operational systems
  • Design, build and support pipelines to deliver business critical datasets
  • Resolve complex data design issues & provide optimal solutions that meet business requirements and benefit system performance

Query Engine Expertise & Performance Tuning:

  • Assist Analytics teams with tuning efforts
  • Curated dataset design for performance

Orchestration:

  • Management of job scheduling
  • Dependency management mapping and support
  • Documentation of issue resolution procedures

Data Access

  • Design and management of data access controls mapped to curated datasets

Leveraging devops best practices, such as IAC and CI/CD to build upon a scalable and extensible data environment


Experience you'll need:

  • Strong experience designing and building end-to-end data pipelines
  • Extensive SQL development experience
  • Knowledge of data management fundamentals and data storage principles

Data modeling:

  • Normalization
  • Dimensional/OLAP design and data warehousing
  • Master data management patterns
  • Modeling trade-offs impacting data management & processing/query performance
  • Knowledge of distributed systems as it pertains to data storage, data processing and querying
  • Extensive experience in ETL and DB performance tuning
  • Hands on experience with a scripting language (Python, bash, etc.)
  • Some experience with Hadoop, Spark, Kafka, Impala, or other big data technologies helpful
     

Familiarity with the technology stacks available for:

  • Metadata management: Data Governance, Data Quality, MDM, Lineage, Data Catalog etc.
  • Data management, data processing and curation: 
  • Postgres, Hadoop, Hive, Impala, Presto, Spark, Glue, etc.

Experience in data modeling for batch processing and streaming data feeds; structured and unstructured data


Experience in data security / access management, data cataloging and overall data environment management

Experience with cloud services such as AWS and APIs helpful

You’d be a great fit if your current track record looks like this:

  • 5+ years of progressive experience data engineering and data warehousing
  • Experience with a variety of data management platforms (e.g. RDBMS (Postgres), Hadoop (CDH, EMR))
  • Experience with high performance query engines (Hive, Impala, Presto, Athena, MPP engines like RedShift)
  • Strong capability to manipulate and analyze complex, high-volume data from a variety of sources
  • Effective communication skills with technical team members as well as business partners. Able to distill complex ideas into straightforward language
  • Ability to problem solve independently and prioritize work based on the anticipated business value

Additional Information

All your information will be kept confidential according to EEO guidelines.

Full-time

Employee Testimonials

Ellen Thompson Pluralsight
Ellen Thompson
Special Projects Leader

My 2.3 years of being a part of Pluralsight has been one of the most rewarding experiences for me both personally and professionally. I've been able to work with THE brightest and kindest people, all of whom are united together to change the world for the better. Pair this with the incredible benefits packages, extraordinary leadership team, and steady astronomical success? If you had asked me if it was possible to find a company like this ~2 years ago, I would've said no.

Shayna Cummings
Software Engineer

Shayna is passionate about advancing educational opportunities for everyone. She serves as a Director for Women Who Code in Boston, a teaching assistant for Girl Develop It and an instructor at General Assembly.

“Greater access to technical education is not only essential for empowering learners, but integral to helping our industry grow and bring in the diversity needed for businesses to evolve. Women and people from underrepresented backgrounds in tech need to be supported and empowered to grow in their roles.

Tech is changing (and has already changed) everything about our lives, and the more people involved in the creation and decision making, the better."

Isaac
Senior Content Technologist

Isaac is an author, speaker, technologist and STEM education advocate, and currently leading the Pluralsight Skills Strategy team. He is active in STEM/STEAM initiatives, and is focused on improving lives through education.

"Pluralsight’s mission is my mission. I had an experience where I realized I wanted to do something about STEM education. Not just worry about it, not complain
that, ‘someone ought to do something,’ but to actually find a career path that will allow me to make a difference. I found Pluralsight, and the rest is history.

Doing things for myself makes me happy; doing things for others makes me joyful."

Maureen Botoman
Engineering Manager

A self-taught programmer, Maureen is a strong advocate for junior devs. She was pivotal in starting Pluralsight’s summer internship program, now in its second year, and is a teaching assistant for the organization Girl Develop It.

“The commitment to being a steward of our community, both in Utah and globally, is one of my favorite things about Pluralsight. We are all so fortunate to have the opportunities that we have, and as a company, we need to come together to help other people receive the same opportunities. We empower people from all walks of life to obtain the tools and skills needed to change the world. Creating pathways for success for people to skill up and find meaningful work, whether or not they grew up with financial means, is one of the most rewarding things I have ever worked on.”

Curtin
Lead Analytics Engineer - Experienc

Curtis is a data visualization expert and Tableau Ambassador, and holds the title of 2016 Tableau Iron Viz champion.

“It’s hard for me to envision a future where my children don’t have the fundamental need for being well-versed in technology. Pluralsight is working on making that a reality in our schools. Our commitment to uplifting the lives of youth is one of the biggest reasons I came to work here.

My favorite opportunity that has stemmed from my Tableau Ambassador status is being able to teach data visualization in the MSIS program at the University of Utah. It’s really cool to be able to promote online technology education by day, and contribute in the classroom environment by night!”

Saswati Samantaray
Data Science Analyst

At the age of 25, Saswati moved from India to Utah to pursue a master’s degree in information systems.

“Coming from a culturally diverse and vibrant country like India, I have witnessed people who have access to the highest level of education, and also people with strong potential who have no access. Working for Pluralsight gives me immense pleasure because of the hope that we will be able to make a positive impact and elevate the lives of bright young people.

At Pluralsight we are a community of lifelong learners—we adapt to change and move forward. There is no greater privilege than doing the work that you actually love, and contributing to build a brighter future for society.”