Brightnes is not a great name either since it changes the black level, not really the brightness.
On many computer LCDs, the brightness only changes the backlight. I have one display that treats brightness as backlight on the DVI input and as a real brightness control on the HDMI input.
I would recommend you calibrate in the following order.
1. Set picture mode (Usually movie, cinema, or custom)
2. Set brightness -> PLUGE Low pattern
3. Set contrast -> Contrast pattern
4. Set color -> Color Bars pattern
5. Set tint -> Color Bars pattern
6. Set sharpness -> Sharpness pattern
7. Color Temp -> 11-step gray scale pattern (This is the user mode option, not the RGB bias/gain controls)
8. Gamma -> Use Image Cropping pattern. You want the mode where the center blends into the background. At least the gamma that gets you the closest. Stand back as far as possible on this one.
If you want to compare different color space output options (422, 444, or RGB), you may need to re-adjust all of the above for each color space.