Big Data challenges associated with software engineering

The seminar of Department No. 1 on "Some challenges of Big Data's software engineering" subject was held at the Institute of Information Technology.

Senior research fellow of the institute Aybaniz Aliyeva who presented the report noted that requirements related to collection of big data, its processing, integration, analysis and archiving exceed standard software platform capabilities for its large-scale data collection, volume, intensity and complexity, creates some problems  during the data processing by conventional methods .

Then,   reporter informed about  main trends in the ICT sector and its impact  on software engineering. technological trends creates two challenges  in the software engineering, she noted.  On one hand,  existing problems  of software engineering  are deepening, because of the size, dynamics and complexity of modern IT.  On the other hand, information technology offers new opportunities for solution  of software problems.

Speaking of software engineering problems of Big Data, A. Aliyeva said that, here includes  lack of development  of software architectures scalable for Big Data, its online diagnostics, provision of software quality  through the technical methods of, software, engineering and so on.

She informed about problems encountered during testing of the software - ETL (Extract, Transform, and Load) that used in large-scale data processing .

The test data generation, and transmission and verification of information about the change.  Also, she presented  structure of the test program proposed to solve the problem. The test gave information about  the data generation, its  transmission and change verification.

In the end, there was an exchange of views on the subject, many questions were answered.

© All rights reserved. Citing to www.ict.az is necessary upon using news