Automation In Data Engineering Using SQL and BI Tools

Authors

  • Harish Goud Kola  Independent Researcher, USA

Keywords:

Automation, Data Engineering, SQL, and BI Tools.

Abstract

In this research article it will provide information regarding the data engineering that utilizes automation in using SQL and BI tools to enhance the workflow of data. The automation of ETL (extraction, transformation, and loading) processes will improve the efficiency, consistency, and quality of a data pipeline. Reduced human interference in the processing of queries in SQL and the integration with BI tools streamline data processes, increase speed, and impact real-time decision-making. This automation minimizes errors and allows for scaling when dealing with large volumes of data. The informations that are presented in this research article is gathered from books, journals, articles and online websites.

References

  1. XIA Jr, Y.U.Q.I., 2019. Data Automation, Data Analytics and Processing System.
  2. Åstrand, A., 2020. Re-engineering a database driven software tool: Rebuilding, automating processes and data migration.
  3. Sethi, F., 2020. Automating software code deployment using continuous integration and continuous delivery pipeline for business intelligence solutions. Authorea Preprints.
  4. Ashok, H., Ayyasamy, S., Ashok, A. and Arunachalam, V., 2020, July. E-business analytics through ETL and self-service business intelligence tool. In 2020 Second International Conference on Inventive Research in Computing Applications (ICIRCA) (pp. 747-751). IEEE.
  5. Banga, D. and Khang, A., 2020. Application of Data Technologies and Tools in Business and Finance Sectors. In Data-Driven Modelling and Predictive Analytics in Business and Finance (pp. 1-17). Auerbach Publications.
  6. Kretz, A., 2019. The data engineering cookbook. Mastering the plumbing of data science.
  7. Michael, A.V. and Ahirao, P., 2020, April. Improved use of ETL tool for updation and creation of data warehouse from different RDBMS. In Proceedings of the 3rd International Conference on Advances in Science & Technology (ICAST).
  8. El-khoury, J., Berezovskyi, A. and Nyberg, M., 2019. An industrial evaluation of data access techniques for the interoperability of engineering software tools. Journal of Industrial Information Integration, 15, pp.58-68.
  9. Romero, O., Wrembel, R. and Song, I.Y., 2020. An alternative view on data processing pipelines from the DOLAP 2019 perspective. Information Systems, 92, p.101489.
  10. Sharma, S., Goyal, S.K. and Kumar, K., 2020. An Approach for Implementation of Cost Effective Automated Data Warehouse System. International Journal of Computer Information Systems and Industrial Management Applications, 12, pp.13-13.
  11. Khan, M., 2020. Distributed and scalable parsing solution for telecom network data.
  12. Rao, T.R., Mitra, P., Bhatt, R. and Goswami, A., 2019. The big data system, components, tools, and technologies: a survey. Knowledge and Information Systems, 60, pp.1165-1245.

IInternational Journal of Scientific Research in Computer Science, Engineering and Information Technology

Downloads

Published

2020-10-30

Issue

Volume 6, Issue 5, September-October-2020

Section

Research Articles

License

Copyright (c) IJSRCSEIT

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

How to Cite

[1]
Harish Goud Kola, " Automation In Data Engineering Using SQL and BI Tools " International Journal of Scientific Research in Computer Science, Engineering and Information Technology(IJSRCSEIT), ISSN : 2456-3307, Volume 6, Issue 5, pp.329-336, September-October-2020.