Data Engineer
Job summary
Applications are invited from qualified persons for the above vacant position.
Job descriptions & requirements
We seek a fearless inventor with an artistic streak who can find creative solutions to tough problems and sculpt brilliant strategies from a mountain of data, someone who can create the digital equivalent of Mona Lisa with only an algorithm and a smile.
The Role
- Implement data architecture design, perform any restructuring required, and review dataset implementations performed by other data engineers.
- Design, create, interpret and manage large datasets to achieve business goals as well ad Process and update third party data sources.
- Design, build, and maintain various parts of the data warehousing and reporting infrastructure, including requirements gathering, ETL development, data modeling, metric establishment, reporting production, and data visualization.
- Gather and process raw, unstructured data at scale (including writing scripts, web scraping, calling APIs, writing SQL queries, etc). Into a form suitable for analysis then consolidate into the data warehouse in order to perform Business Intelligence and advanced analysis.
- Conduct performance tuning to be able to optimize the application of data across all layers.
- Evaluate datasets for accuracy and quality using statistical data quality procedures, software, or test-driven approaches that ensure quality assurance and solve any issues which may arise.
- Perform data updates, indexing, and maintenance in application database; as well as maintain data files in both hard copy and electronic versions.
- Improve data foundational procedures, guidelines and standards and develop best practices for data management, maintenance, reporting and security.
- Work with Business Customers to understand business requirements and implement solutions and with business owners to develop key business questions and to build datasets that answer those questions.
- Help implement data management projects and support business decisions with ad hoc analysis when needed.
- Provide self-serve analytical solutions to users to analyze medium to large datasets and run mathematical models without need of IT resources.
- Bachelor’s degree in computer science or software engineering from a recognized university.
- 3 to 5 years of applied data experience.
- Expert knowledge in different (NoSQL or RDBMS) databases such as MongoDB or Redis.
- Experience with Data warehousing architecture and data modeling best practices, including performance tuning techniques.
- Exposure to one or more ETL tools and a solid understanding of ETL pipelines, including functional testing and data source alerting.
- Advanced skills in a scripting language such as Python/Java/Scala with ability to tune Hadoop solutions to improve performance and end-user experience
- Excellent Problem solving skills with passion for leveraging data to drive significant business impact.
Important safety tips
- Do not make any payment without confirming with the BrighterMonday Customer Support Team.
- If you think this advert is not genuine, please report it via the Report Job link below.