Data Engineer - #10496828

Location: Curitiba, Parana (Can be 100% remote for the right candidate)
Company: Wiley (CLT Position)

Our mission is to unlock human potential. We welcome you for who you are, and the background you bring, and we embrace individuals who get excited about learning. Bring your experiences, your perspectives, and your passion; it’s in our differences that we empower the way the world learns.

About the Role:

This position within the Wiley Data Analytics & Insights team, is responsible for functioning as the Data Engineer, to develop and maintain data pipelines from multiple data sources into our Data Lake environment. This individual will work very closely with the other development leads, data engineers, and data architects to build and maintain data pipelines going to different zones of the Snowflake Data Warehouse environment. Determine the optimal approach for extracting, transforming, and loading data into different zones of Data Lake (Raw/Native, Processed/Transformed, Enriched, Archive). This includes design and development to prepare data for movement storage & consumption Views, ELT Processes, Extracts & other processes that manipulate, aggregate, clean, or enrich the data. The individual should demonstrate a thorough understanding of business validations and data quality. They should apply these principles diligently within our processes, aligning with the specific use cases.

This data lake would see regular addition of datasets from internal and external sources

deemed important for Wiley’s data analytics and insights requirements. In some cases, this role may involve building repeatable data feeds to and from platforms such as, Salesforce, SAP, MDM, Eloqua, e-commerce websites, etc. The position requires development skills to enable the matching and linking of internal and external data sources (especially as it relates to Customer and products) using analytical techniques/tools. The role will have frequent interaction/collaboration with Solutions Architects, Data Architects, BI & Analytics Development, Data Engineering, Marketing, Sales, Application/Product teams and Enterprise Architects to support Wiley’s Data Analytics and Insights roadmap.

How you will make an impact:

• Design and implement secure data pipelines into a Snowflake data warehouse from on-premise and cloud data sources
• Define best practices and standards for data pipelining and integration with Snowflake data lake and warehouses in collaboration with Data Architect and other Data leads
• Design and implement high-performing data pipelines feeding downstream systems
• Collaborate with onshore/ offshore data engineers, BA, and Scrum Masters who will be building or testing data applications in Snowflake environment.
• Design and implement high-performing BI dashboard integrations Cognos and QlikView working with reporting and data visualization developers
• Ensure enterprise security and access control policies are adhered to in the solution
• Creation of architecture and design artifacts and documents
• Conduct design and code reviews

What we look for:

• B.S Computer Science or related degree
• 4+ years' experience in data pipeline architecture and data modelling
• Demonstrably deep understanding of SQL and relational databases (Snowflake preferred)
• Experience with Snowflake SnowSQL and writing user-defined functions would be a plus
• Hands-on experience with Python, Scala, Java, SQL, and tools like NIFI, Attunity, Spark (Databricks/Qubole), etc.
• Hands-on experience with data pipeline tools within cloud-based environments (Argo, Airflow, Luigi, DBT)
• Hands-on experience with CI/CD tools and practices (CircleCI, Travis, Jenkins)
• Hands-on experience with AWS (SQS, S3, Kinesys, Firehose, MKS, Lambda)
• Experience with open-source data warehouse tools
• Constantly improve product quality, security, and performance
• Write good code, performant code (Python preferred)

About Wiley:

Wiley is a trusted leader in research and learning, our pioneering solutions and services are paving the way for knowledge seekers as they work to solve the world’s most important challenges. We are advocates of advancement, empowering knowledge-seekers to transform today’s biggest obstacles into tomorrow’s brightest opportunities.

With over 200 years of experience in publishing, we continue to evolve knowledge seekers’ steps into strides, illuminating their path forward to personal, educational, and professional success at every stage. Around the globe, we break down barriers for innovators, empowering them to advance discoveries in their fields, adapt their workforces, and shape minds.

When applying, please attach your resume/CV to be considered

#LI-AH1

Location/Division:

Curitiba, State of Paraná, Brazil