Data Engineer

New York, NY

Responsibilities

 

  • Establish and maintain best practices for our data infrastructure
  • Develop next-gen data pipelining and ETL based on open source data pipeline tools and cloud-based ecosystems that can deal with varied data types from disparate sources
  • Develop and tune data storage and processing systems at scale
  • Build real-time data processing systems
  • Build automated systems to continually monitor data quality and integrity
  • Work closely with stakeholders across company to ensure data is accurate, timely, and useful

 

 

 

 

 

Requirements

 

  • 3+ years’ experience in data/software engineering or related field
  • Fluency in Python and SQL, experience with Golang, C, C++, Java, or Scala is a plus
  • Demonstrated experience with distributed computing (Kafka, Storm, Spark, Hadoop, etc.)
  • Experience with NoSQL databases
  • Proficiency in using and managing cloud infrastructure, preferably AWS
  • Linux and Bash competence
  • Experience integrating with Salesforce a plus

 

 

 

 

 

Note: Qualified candidates will be contacted within 2 business days of application. If an applicant does not meet the above criteria, we will keep your resume on file for future opportunities and may contact you for further discussion.

Date Posted 3/7/2019
Salary Open






(2MB Max; allowed file formats: doc, docx, pdf, pptx, txt)



characters left