Quality House Ltd.
  • Course Calendar
  • info@qualityhouse.com
  • +359 2 958 33 06
  • About Us
      • Company Overview (3)
      • What We Do
      • Team Power
      • Careers
      • Stay Updated (2)
      • News
      • FAQ
      • Business Relationships (3)
      • Customers
      • Partners
      • Testimonials
  • QA Profiles
      • Available QA Profiles (2)
      • Software Technologies & Platforms
      • Project Experience
      • Delivery (3)
      • On-site
      • Off-site
      • Hybrid
      • Pricing (2)
      • Dedicated Team
      • Time & Materials
  • Testing Services
      • By App Type (3)
      • Mobile
      • Web
      • Desktop
      • By Testing Type (6)
      • Functional
      • Test Automation
      • Security
      • Regression & Retesting
      • Load & Performance
      • Acceptance
      • By Industry (6)
      • Software
      • Telecom
      • E-Commerce
      • Media & Entertainment
      • Finance
      • Automotive
      • By Company Size (3)
      • Start ups
      • SME
      • Enterprises
  • Professional Courses
      • Overview (3)
      • Introduction
      • Our Trainers
      • Course Calendar
      • ISTQB FL (1)
      • Foundation Level
      • ISTQB AGILE (1)
      • Agile Tester Foundation
      • ISTQB AL (3)
      • Test Manager
      • Technical Test Analyst
      • Test Analyst
      • ISTQB SPEC. (2)
      • Test Automation Eng
      • Security Tester
      • Other Courses (2)
      • IREB® CPRE FL
      • Scrum Master
  • Knowledge Hub
      • Case Studies (11)
      • Long-term Functional Testing & Automation Project
      • Bringing Mobile Technologies to School
      • Process Workflow by the Book
      • Rapid Fire, High Intensity Quality Assurance...
      • Deliver a Swift, Structure Testing Solution...
      • Integration with Systems & People
      • MORE...
      • Videos (5)
      • Webinars
      • Training
      • Test Outsourcing in Eastern Europe
      • Acceptance Testing
      • 10 Signs Your Testing is Not Enough
      • Articles (27)
      • Introducing: The Future QA (Part 5)
      • Even More Trends (Part 4)
      • Artificial Intelligence and Machine Learning: I’ll Be Back…But Not Yet (Part 3)
      • Some Trend Analysis (Part 2)
      • Testing is dead. Long live the Testing (Part 1)
      • Striking The Balance: Is DevOps Going To Kill QA? (Part 5)
      • MORE...
  • Contact Us
    • Bulgaria
    • Serbia
    • Romania

Artificial Intelligence and Machine Learning: I’ll Be Back…But Not Yet (Part 3)


Apart from automation, we also see the supposed rapid growth of machine learning and AI techniques.

They have been applied to software development to improve the productivity of the project teams and the quality of the software. As we face the advancement and growth of applications of AI and ML (machine learning) in practice, there will be more intelligent test automation technologies and tools that are smarter in generating test cases, test scripts, test data, etc. This will also bring advancement to formulating test scenarios, predicting application behaviors, etc.
They (AI and ML) will change the future for sure, such as the testing scope and workloads – imagine having robotic automation tools that will ease the workloads, because everybody has experienced working late because of a delay in the project. Debugging adequacy – as AI bots can work 24/ 7 easily, they can be used to utilize debugging projects overnight or over the weekend. And the workload for the humans – test engineers will be truly less than before.
There are already a lot of examples how AI and ML techniques are entering our lives. For example, the San Francisco – based start – up Appdiff is bringing machine learning “bots” online as QAs. Another company, dinCloud, announced “James” – a virtual robot QA. Infostretch announced it will offer artificial intelligence in software testing through a brand new service called Predictive and Prescriptive QA. That all happened in 2017….

We decided to take a closer look into the Appdiff case which is quite interesting in general.

Appdiff taught its’ machine learning algorithms how to know if the result of a given activity was likely to uncover a deformity. Appdiff tests about 90% of the surface area of a typical mobile application. If we compare that to a human tester, it is clear that it is quite rare that companies with human testers test as much as 90% of the surface area of a mobile application. As for the 10% left, it is either too costly or too complex for most companies to invest in testing it.

You definitely know, bots can both interact with people and machines. Still, testing, at least for us, requires more than just interaction. Testers have an understanding of the business domain, a set of heuristics for exposing defects. They can also put themselves in the shoes of both the best and the clumsiest software user. They pay special attention to the client’s needs and have intricate understanding of the solution purpose – by analyzing how a software is used and in what ways it can go wrong. We can draw the conclusion here, that if you are smarter, there is no way you can be replaced.

If you want in your heart to be a very good tester and not be replaced by the AI and ML, well then…think differently. You are not to use a common testing strategy. Why? Because of the differences, we face now with the complex systems we produce:

  • AI Applications are non – deterministic and quite probabilistic;
  • They are quite dependent on humungous amount of data;
  • There isn’t a defined input/ output;
  • It is difficult to predict all scenarios;
  • Continuous learning from past behavior is also what happens;
So, the traditional approach and testing tools will definitely not meet the needs of testing these systems…Humans have to invent new ways…and to reinvent them…
Of course, as AI and ML may be seen as the end of testing, we took the liberty to share that examples of AI going wrong are not uncommon.

On the 19th of March, 2018 there was a fatal accident with a self – driving car in Arizona, USA.

The car, during the accident, was in autonomous mode and hit a pedestrian in Tempe, Arizona. The woman passed away in the hospital. It is also reported that there was a human driver inside the car during the accident. The car was part of Uber’s fleet and that is the first reported deadly accident with a self – driving vehicle. We wonder – who is to blame? The car or the driver who did not attempt to take over the control of the car after seeing what was going to happen. After a US federal investigation, it is thought that the car did not stop because the system put in place to carry out emergency stops in dangerous situations was disabled.
In fact, Tesla Motors was the first to disclose a death involving a self – driving car in 2016 when the sensors of a Model S driving in autopilot mode failed to detect a large white 18 – wheel truck and trailer crossing the highway. The car drove full speed under the trailer, causing the collision that killed the 40 – year old behind the wheel in the Tesla.

Then there is the Microsoft fail that happened in March, 2018(thankfully not a fatal one). Microsoft released the AI chat bot Tay. It was designed to be a talking teen AI chat bot, built to mimic and converse with users in real time. But people (not surprisingly) took advantage of Tay’s machine learning capabilities and coaxed it into saying racist, sexist and generally bad things. Tay started posting racist tweets on Twitter and Microsoft had to take it down just a few days after release.

Besides Microsoft, Google also had a bad experience in relation to the Google Photos App that was released in 2015.

What the Google Photos did is label two black people as “gorillas”. The new app was released in May 2015 and was supposed to automatically tag uploaded pictures by using its own artificial software. After the “gorillas” tagging, Google apologized for it.

And then, we have the moral dilemma of the AI development.

In April 2018, a lot of experts in the AI field harshly criticized their colleagues from South Korea who are working on the creation of a military killer robot (reported by The Verge). The development of that robot is tasked to the Korea Advanced Institute of Science and Technology/ KAIST. The scientists condemned the task of KAIST and asked for a ban to the creation of military AI systems. It looks like the days of extinction foreseen by the Terminator are coming…

But let’s leave the doomsday thoughts for now. There are more pressing testing matters to discuss – such as the importance of security that we will be looking at in the next part of ‘The Future of Software Testing’.

Knowledge Hub

  • Case Studies (11)
    • Long-term Functional Testing & Automation Project
    • Bringing Mobile Technologies to School
    • Process Workflow by the Book
    • Rapid Fire, High Intensity Quality Assurance...
    • Deliver a Swift, Structure Testing Solution...
    • Integration with Systems & People
    • Manual Testing for Website...
    • Specific Test Automation for Hardware Devices
    • Long-term Partnership and Collaboration
    • Quality Assurance & Validation...
    • Synchronized Back & Front-End Performance...
  • Videos (5)
    • Webinars
    • Training
    • Test Outsourcing in Eastern Europe
    • Acceptance Testing
    • 10 Signs Your Testing is Not Enough
  • Articles (27)
    • Introducing: The Future QA (Part 5)
    • Even More Trends (Part 4)
    • Artificial Intelligence and Machine Learning: I’ll Be Back…But Not Yet (Part 3)
    • Some Trend Analysis (Part 2)
    • Testing is dead. Long live the Testing (Part 1)
    • Striking The Balance: Is DevOps Going To Kill QA? (Part 5)
    • Even More Fails (Part 4)
    • The Factors for Success & A Little Bit of Fail History (Part 3)
    • What Did I Miss This Time? (Part 2)
    • A Bug's Life: The Basics (Part 1)
    • 10 Signs Testing is Not Enough (Part 5)
    • 10 Signs Testing is Not Enough (Part 4)
    • 10 Signs Testing is Not Enough (Part 3)
    • 10 Signs Testing is Not Enough (Part 2)
    • 10 Signs Testing Is Not Enough (Part 1)
    • How to Succeed in the Outsourcing Industry?
    • Future Trends in Outsourcing
    • Main Reasons Outsourcing Projects Fail
    • Marketplace of Eastern Europe
    • Top Outsourcing Destinations in 2016
    • The Outsourcing Market: Facts & Figures
    • What is Outsourcing?
    • Measure Twice, Accept Once (Part 4)
    • Measure Twice, Accept Once (Part 3)
    • Measure Twice, Accept Once (Part 2)
    • Measure Twice, Accept Once (Part 1)
    • Software Testing As a Key Factor For Startups to Build Trust in Their Product

 

About Us

In all we do, from testing, consulting and assessing to outsourcing services and doing the research to recommend automated tools, we add value to the business development process through understanding your business and providing metrics to prove the effectiveness of our service. Quality House is here for you for the long run!
GDPR Terms & Conditions
ISO 9001:2015 certified
 Company

Useful Links

Testing ServicesBy App Type
By Testing Type
By Industry
By Company Size

QA ProfilesAvailable QA Profiles
Delivery
Pricing
Professional CoursesISTQB Foundation Level
ISTQB Agile Tester Foundation
ISTQB Advanced Level
ISTQB Specialist Level
Other Courses
Course Calendar

Knowledge HubCase Studies
Videos
Articles



Contact Us

  • Ivan Vazov district, 1 Balsha str., Fl. 3, 1408 Sofia, Bulgaria

  • +359 2 958 33 06

  • info@qualityhouse.com

Follow Us

GDPR Terms and Conditions
© Copyright 2023 Quality House Ltd. All Rights Reserved.