Data Security and Privacy in Data Engineering

Authors

  • Ranjana Rajiv Gaikwad Lead Data & Analytics Engineer, Chevron Eurasia Business Unit LLP Tengizchevroil Atyrau, Republic of Kazakhstan

DOI:

https://doi.org/10.53469/jrse.2024.06(08).01

Keywords:

Data Engineering, data, information, modern technologies, IT, security, confidentiality

Abstract

Due to the increased amount of data, it has become a key resource for strategic decision - making, data security and privacy issues are becoming more relevant than ever. In the context of Data Engineering, where vast amounts of information are collected, processed and stored, ensuring reliable data protection and maintaining their confidentiality becomes a top priority. Effective data management involves not only their technical processing, but also a guarantee that the entire information lifecycle is accompanied by appropriate security measures. The purpose of the work is to consider such an important aspect when working with data as data security and confidentiality in Data Engineering. The methodological foundations are: scientific works of domestic and foreign authors, articles, expert opinions.

References

Big Data Security and Privacy Issues – A survey. [Electronic resource] Access mode: https://ukdiss. com/examples/big-data-security-and-privacy-issues.php. (accessed 25.01.2024).

What is data mining? [Electronic resource] Access mode: https: //www.educba. com/what-is-data-engineering/.–(accessed 25.01.2024).

What is date engineering and its role. [Electronic resource] Access mode: https://sky. pro/media/chto-takoe-data-inzhiniring-i-ego-rol/.–(accessed 25.01.2024).

Differential privacy — data analysis with confidentiality (introduction to the series). [Electronic resource] Access mode: https://habr.com/ru/companies/domclick/articles/526724/.(accessed 01/25/2024).

Privacy, security and social implications of data mining. [Electronic resource] Access mode: https: //www.geeksforgeeks.org/конфиденциальность,security and social implications of data mining/.–(accessed 25.01.2024).

Lin, Z., Wang, Z., Zhu, Y., Li, Z., & Qin, H. (2024). Text Sentiment Detection and Classification Based on Integrated Learning Algorithm. Applied Science and Engineering Journal for Advanced Research, 3(3), 27-33.

Wang, Z., Zhu, Y., Li, Z., Wang, Z., Qin, H., & Liu, X. (2024). Graph neural network recommendation system for football formation. Applied Science and Biotechnology Journal for Advanced Research, 3(3), 33-39.

Yuan, B., Song, T., & Yao, J. (2024, January). Identification of important nodes in the information propagation network based on the artificial intelligence method. In 2024 4th International Conference on Consumer Electronics and Computer Engineering (ICCECE) (pp. 11-14). IEEE.

Shemale R. Big Data Statistics For 2024 (Growth, Market Size & More) // demandsage.2024. [Electronic resource] Access mode: https: //www.demandsage. com/big-data-statistics/""

Yao, J., & Yuan, B. (2024). Research on the Application and Optimization Strategies of Deep Learning in Large Language Models. Journal of Theory and Practice of Engineering Science, 4(05), 88-94.

Xu, X., Yuan, B., Song, T., & Li, S. (2023, November). Curriculum recommendations using transformer base model with infonce loss and language switching method. In 2023 5th International Conference on Artificial Intelligence and Computer Applications (ICAICA) (pp. 389-393). IEEE.

Yuan, B. (2024). Design of an Intelligent Dialogue System Based on Natural Language Processing. Journal of Theory and Practice of Engineering Science, 4(01), 72-78.

Lyu, H., Wang, Z., & Babakhani, A. (2020). A UHF/UWB hybrid RFID tag with a 51-m energy-harvesting sensitivity for remote vital-sign monitoring. IEEE transactions on microwave theory and techniques, 68(11), 4886-4895.

Big Data Security and Privacy Issues – A survey. [Electronic resource] Access mode: https: //ukdiss. com/examples/big-data-security-and-privacy-issues. php. – (accessed 25.01.2024).

Xu, J., Jiang, Y., Yuan, B., Li, S., & Song, T. (2023, November). Automated Scoring of Clinical Patient Notes using Advanced NLP and Pseudo Labeling. In 2023 5th International Conference on Artificial Intelligence and Computer Applications (ICAICA) (pp. 384-388). IEEE.

Differential privacy — data analysis with confidentiality (introduction to the series). [Electronic resource] Access mode: https: //habr. com/ru/companies/domclick/articles/526724 /. – (accessed 01/25/2024).

The growing role of privacy technology in the future of data security. [Electronic resource] Access mode: https: //www.immuta. com/blog/privacy-engineerings-emerging-role /. – (accessed 25.01.2024).

Xu, Y., Lin, Y.-S., Zhou, X., & Shan, X. (2024). Utilizing emotion recognition technology to enhance user experience in real-time. Computing and Artificial Intelligence, 2(1), 1388. https://doi.org/10.59400/cai.v2i1.1388

Ji, H., Xu, X., Su, G., Wang, J., & Wang, Y. (2024). Utilizing Machine Learning for Precise Audience Targeting in Data Science and Targeted Advertising. Academic Journal of Science and Technology, 9(2), 215-220.

Ma, Y., Shen, Z., & Shen, J. (2024). Cloud Computing and Hyperscale Data Centers: A Comparative Study of Usage Patterns. Journal of Theory and Practice of Engineering Science, 4(06), 11-19.

Ren, Z. (2024). VGCN: An Enhanced Graph Convolutional Network Model for Text Classification. Journal of Industrial Engineering and Applied Science, 2(4), 110-115.

Ren, Z. (2024). Enhanced YOLOv8 Infrared Image Object Detection Method with SPD Module. Journal of Theory and Practice in Engineering and Technology, 1(2), 1–7. Retrieved from https://woodyinternational.com/index.php/jtpet/article/view/42

Yuan, B., & Song, T. (2023, November). Structural Resilience and Connectivity of the IPv6 Internet: An AS-level Topology Examination. In Proceedings of the 4th International Conference on Artificial Intelligence and Computer Engineering (pp. 853-856).

Yuan, B., Song, T., & Yao, J. (2024, January). Identification of important nodes in the information propagation network based on the artificial intelligence method. In 2024 4th International Conference on Consumer Electronics and Computer Engineering (ICCECE) (pp. 11-14). IEEE.

Yuan, B. (2024). Design of an Intelligent Dialogue System Based on Natural Language Processing. Journal of Theory and Practice of Engineering Science, 4(01), 72-78.

Yao, J., & Yuan, B. (2024). Research on the Application and Optimization Strategies of Deep Learning in Large Language Models. Journal of Theory and Practice of Engineering Science, 4(05), 88-94.

Yao, J., & Yuan, B. (2024). Optimization Strategies for Deep Learning Models in Natural Language Processing. Journal of Theory and Practice of Engineering Science, 4(05), 80-87.

Xu, X., Yuan, B., Song, T., & Li, S. (2023, November). Curriculum recommendations using transformer base model with infonce loss and language switching method. In 2023 5th International Conference on Artificial Intelligence and Computer Applications (ICAICA) (pp. 389-393). IEEE.

Xu, J., Jiang, Y., Yuan, B., Li, S., & Song, T. (2023, November). Automated Scoring of Clinical Patient Notes using Advanced NLP and Pseudo Labeling. In 2023 5th International Conference on Artificial Intelligence and Computer Applications (ICAICA) (pp. 384-388). IEEE.

Yuan, B., & Song, T. (2023, November). Structural Resilience and Connectivity of the IPv6 Internet: An AS-level Topology Examination. In Proceedings of the 4th International Conference on Artificial Intelligence and Computer Engineering (pp. 853-856).

Yuan, B., Song, T., & Yao, J. (2024, January). Identification of important nodes in the information propagation network based on the artificial intelligence method. In 2024 4th International Conference on Consumer Electronics and Computer Engineering (ICCECE) (pp. 11-14). IEEE.

Yuan, B. (2024). Design of an Intelligent Dialogue System Based on Natural Language Processing. Journal of Theory and Practice of Engineering Science, 4(01), 72-78.

Yao, J., & Yuan, B. (2024). Research on the Application and Optimization Strategies of Deep Learning in Large Language Models. Journal of Theory and Practice of Engineering Science, 4(05), 88-94.

Yao, J., & Yuan, B. (2024). Optimization Strategies for Deep Learning Models in Natural Language Processing. Journal of Theory and Practice of Engineering Science, 4(05), 80-87.

Xu, X., Yuan, B., Song, T., & Li, S. (2023, November). Curriculum recommendations using transformer base model with infonce loss and language switching method. In 2023 5th International Conference on Artificial Intelligence and Computer Applications (ICAICA) (pp. 389-393). IEEE.

Xu, J., Jiang, Y., Yuan, B., Li, S., & Song, T. (2023, November). Automated Scoring of Clinical Patient Notes using Advanced NLP and Pseudo Labeling. In 2023 5th International Conference on Artificial Intelligence and Computer Applications (ICAICA) (pp. 384-388). IEEE.

Wang, Z. (2024, August). CausalBench: A Comprehensive Benchmark for Evaluating Causal Reasoning Capabilities of Large Language Models. In Proceedings of the 10th SIGHAN Workshop on Chinese Language Processing (SIGHAN-10) (pp. 143-151).

Wang, Z., Zhu, Y., He, S., Yan, H., & Zhu, Z. (2024). LLM for Sentiment Analysis in E-commerce: A Deep Dive into Customer Feedback. Applied Science and Engineering Journal for Advanced Research, 3(4), 8-13.

Wang, Z., Yan, H., Wang, Y., Xu, Z., Wang, Z., & Wu, Z. (2024). Research on autonomous robots navigation based on reinforcement learning. arXiv preprint arXiv:2407.02539.

Jiang, L., Yu, C., Wu, Z., & Wang, Y. (2024). Advanced AI framework for enhanced detection and assessment of abdominal trauma: Integrating 3D segmentation with 2D CNN and RNN models. arXiv preprint arXiv:2407.16165.

Downloads

Published

2024-08-29

How to Cite

Gaikwad, R. R. (2024). Data Security and Privacy in Data Engineering. Journal of Research in Science and Engineering, 6(8), 1–6. https://doi.org/10.53469/jrse.2024.06(08).01