Data Platform Engineers at Shopify support the organization in making better decisions. We deploy and maintain a variety of scalable technologies for extracting and transforming a multitude of different sources of data, and spend time working with the Data Analysts to model that data into a form supporting analysis. We have a petabyte scale Hadoop cluster running Apache Spark for transformation, and a variety of analytics technologies on top of it.
Extensive software development experience - you are proficient with things like software design patterns, code review, a variety of languages and paradigms, TDD, etc.Extensive database experience - you are familiar with things like SQL query authoring, table design patterns for OLAP and OLTP, a variety of databases, and the tradeoffs between themInfrastructure experience - you'll need to be familiar with administering server clusters, incident response, analyzing performance at all levels of the stack, and capacity planningData warehousing experience - ideally, experience with dimensional modelling, metadata management, data cleaning and conforming, and warehouse query patternsTeam work experience - you'll need to be someone who enjoys working together with other engineers, discussing solutions to problems, and supporting others in their goals
Text title: ?It'd be great if you have experience with:
Python expertiseScala expertiseTableau Server administration or Tableau Desktop report authoringBusiness Intelligence: defining metrics, conforming different definitions, and experimentation methodologyHadoop administration, MapReduce job authoring and supportRemote team/distributed work environment