32
votes
Accepted
Does unit testing spot bugs that QA testing typically does not?
Unit testing finds some errors with minimal work. Make a change. Build. Fix compiler errors. Run. Fix obvious errors. Run unit tests. Fix more obvious errors. Run QA test cycle. Fix hard to find ...
- 49.4k
21
votes
Does unit testing spot bugs that QA testing typically does not?
Does unit testing spot bugs that QA testing typically does not?
Every form of testing is a disjunction with every other form. Which is a fancy way to say they overlap but none completely covers any ...
- 120k
14
votes
Accepted
Are end-to-end and integration tests worth it for non-mission critical stuff?
It does not matter if you implement E2E and integration tests or not, you need a backup plan either way. Never expect a system to be bug-free just because it was tested.
Thus, in your cost ...
- 220k
13
votes
Grafana - detecting abnormal behavior of applications
Welcome to the world of data visualization and pattern identification. To be short: there's no solution for the problem you are encountering.
You say:
Abnormal behavior can easily be recognized in ...
- 139k
12
votes
Steps to achieve the best code quality?
What I didn't hear you mention was peer reviews.
You did say 'we' a lot. So I assume this is a team. The best use of a team is to check that you're not simply deluding yourself about how awesome you ...
- 120k
10
votes
Accepted
Is it legit to close a bug as duplicate of another still open bug?
In the cases in which it is absolutely clear that the issue/root cause is the same (for example crashes with the same traceback occurring in the same conditions, only reported by different customers) ...
- 887
10
votes
Does unit testing spot bugs that QA testing typically does not?
Technically, it's the other way around.
Unit tests exist for the purpose of flagging issues as close to the developer as possible - which you maximize by having the developer write and run tests as ...
- 59.5k
9
votes
Are end-to-end and integration tests worth it for non-mission critical stuff?
Perhaps counter intuitively, automated testing can actually reduce development time vs no testing. So it's a win win.
The idea is that the tests contribute on a number of levels
Force strict ...
- 84.4k
8
votes
Accepted
Is there a "DevTest" or "DevQA" equivalent to "DevOps"?
Terms like DevOps are subject to the whims of enthusiastic marketing and consultancy folk and all too quickly become "must have" buzz words. But underlying it is a simple concept: infrequent, "big ...
- 39.6k
8
votes
Accepted
Is it possible to assess the quality of software if the customer keeps changing what it is supposed to do?
Having a moving target is not a reason to skip tests and quality assessment. Sometimes clients needs to see something, to be able to better understand what they really need and what not. Welcome ...
- 82.1k
8
votes
Accepted
Quality Assurance for Large SQL Script Releases
The key of the problem is here:
Eyeballing the database afterwards helps but, it introduces a lot of human error.
Making this eyeballing more automated and systematic requires a good specification ...
- 82.1k
7
votes
Accepted
Git branch model with QA and branches
Which Git branching model you should choose depends completely on the development process you want to use. The popular “git flow” you mentioned is concerned with products that have clear releases and ...
- 136k
7
votes
Accepted
Does defect density measure QA or dev effectiveness?
I have read that it measures the effectiveness of QA but I do not get it
It is surely a good idea to take any such statement about metrics with a grain of salt.
The only way I can think of to use the ...
- 220k
7
votes
Accepted
How important is sprint test plan in agile?
The biggest problem I see with this is that you're looking at a mini-waterfall rather than a sprint. The description you're giving above forces the team to deliver all or nothing. What if they have 12 ...
- 3,436
6
votes
Is it legit to close a bug as duplicate of another still open bug?
You want to have a clear view of the issues with a software.
If a system has 10 issues, you want 10 open bugs. Not 10.000 open bugs of duplicates.
You also want the minimum amount of administration. ...
- 13.3k
6
votes
Accepted
What is the relationship between IV&V professionals, Testers and QA engineers?
Software verification and validation are all the activities that ensure that the software fulfils all the needs and requirements for its intended purpose. As such V&V is part of the larger set of ...
- 82.1k
6
votes
Kanban board - How to handle defects found in testing phase?
The ticket should be in the column it belongs in, which sounds pretty stupid to say and is exactly why I'm mentioning it. The ticket was being developed, then handed off to QA who found some defects. ...
- 512
6
votes
Accepted
An idea about cooperation between development engineers and test engineers
This looks like a non-iterative version of Acceptance Test Driven Development. Like all non-iterative processes, it suffers from the fact that it assumes it can perfectly predict the future, that the ...
- 105k
6
votes
In unit testing should I check if a method is being called or just check the result?
It depends on what you are testing.
For pure simple helper as you have here, I may not really bother about them in my test on higher end functions, and have unit test dedicated to the helper function.
...
- 141
6
votes
How to increase confidence in changes without a great test suite?
Tests prevent regressions. There are other tools which would prevent regressions, but unfortunately they are either less effective (example: code reviews), or extremely expensive (example: formal ...
- 139k
6
votes
Quality Assurance for Large SQL Script Releases
Ensuring the test environment aligns closely with production is critical for reliable SQL script releases, as mentioned by @Christophe. This includes using anonymised or synthetic datasets that mirror ...
- 802
5
votes
Managing QA testing when there's pressure to merge things at the earliest possible
I would do QA on the dev (or master in your case) branch rather than the feature branch.
Devs should test on the feature branch to ensure the features are complete, but QA should test the product as ...
- 84.4k
5
votes
Accepted
Features to catch bugs that make it to production
You ask:
If you assume that testing/debugging/QA cannot catch even the simplest of bugs, and that you must code in extra features to protect against these simple bugs -- isn't that indicative that ...
- 4,981
5
votes
Accepted
How to distribute code reviews workload in a small team?
There are a number of ways to ease/share the burden:
Tools
You don't say what languages you're using but there are many tools out there that can do basic analysis for you such as StyleCop, ReSharper,...
- 9,843
5
votes
Accepted
How to prevent overwriting changes in TFS version control by another team member
There are two techniques that work together to avoid this type of scenario from occurring:
Step 1: write a failing test before fixing the bug
When the bug has been found, the first thing to do is to ...
- 39.6k
5
votes
In unit testing should I check if a method is being called or just check the result?
Test the API.
If Helper has tests of its own, you mock it here
If Helper is an internal class to this API, don't let it leak (not even to tests).
- 296
5
votes
Steps to achieve the best code quality?
You describe many technical solutions so I think you have that bit covered. The next step would be to consider some broader questions like
What is quality?
To whom is this quality?
Is it important to ...
- 379
5
votes
Is it possible to assess the quality of software if the customer keeps changing what it is supposed to do?
If the software is already in QA at the point when a customer requests a change in requirements, then typically it should not impact QA testing because the goal should be to verify the current version ...
- 12.1k
5
votes
Quality Assurance for Large SQL Script Releases
You can write small tests in sql at the end of the script and roll back if they fail.
You can test migration scripts by comparing the database schema against a known good state (your already migrated ...
- 84.4k
5
votes
Grafana - detecting abnormal behavior of applications
Not sure about grafana, but most logging stacks offer some sort of machine learning anomaly detection these days
eg: https://www.elastic.co/docs/explore-analyze/machine-learning/anomaly-detection
...
- 84.4k
Only top scored, non community-wiki answers of a minimum length are eligible