One of the more crucial parts of our job at Pickr as technology journalists is the need to recreate the same-same experience between test cycles.
As such, Pickr has specific methodologies for various products as detailed on this page, because while an experience is always going to be subjective, it is also backed up by the same approaches to indicate that reviews and analysis aren’t just a dice throw in the dark, and also aren’t just a casual first impression (except where otherwise indicated).
It does need to be noted, however, that the methodology found in this section is only applicable to reviews published by Pickr.
Websites tracked by Pickr’s tracking system are subject to their own methodologies.
Mobile (phones and smartphones)
Phones and smartphones can take anywhere between two days and six days to review, but usually take closer to three or four.
Typically, a smartphone review is based around the general use-case scenario all phones are made for: day-to-day use.
Because we can’t simulate what a day is exactly, Pickr’s test team takes it through the course of their day.
This means the phone is charged throughout the night and taken off charge at 6am, with the course of the day tested with streaming audio, web surfing, email browsing, picture taking, and even a few phone calls here and there. The phone is also setup and connected to no less than two push-based email accounts, allowing work and home to be accounted for in the email world, and testing how much strain the push service has on the battery.
Connection tests are also performed for the handset, allowing speed tests to not just simulate a strain on the device, but also demonstrate actual real world speeds that are attainable. Unless otherwise noted, all speed tests are based in Sydney’s CBD and North Sydney (Australia), and both on Telstra’s 4GX network.
Audio on day one is handled exclusively with wired headphones, allowing a picture to be painted of how well the phone handles wired versus wireless technology, and throughout this time, battery percentages are captured at random intervals.
The battery is pushed to its limits through that regular day, which shows us what the battery will do under normal situations, with some battery tests pushing over into the second or third day.
When that first test is done, we do it again for what is labelled as the second test day (even if it might already be the second or third day), and this time we switch on wireless devices, connecting the phone to Bluetooth headphones and at least one smart device, like a smartband or a smartwatch.
After both of these major test days are completed, we continue using the device until the review is completed, usually in the second day of methodology to see if it is consistent.
Audio (headphones, speakers)
Audio products such as headphones, earphones, in-ear monitors, speakers, soundbars, and generally anything else that transmits sound has to be reviewed based on a combination of technical description and subjective listening.
Reviewing always has the downside of being totally subjective, though Pickr’s reviewer likes to think an open program of audio helps to make the process a little more transparent.
As such, Pickr’s audio reviews are handled by a sound test that you can listen to yourself using either Apple Music, Google Play Music, or Spotify.
The playlist we use is one stored in lossless audio, much of which is 24-bit, allowing the reviewer to hear the best source of sound that is possible, whether or not you agree with the virtues of 24-bit high-resolution audio.
From 2019 onwards, Pickr’s sound test can be heard using the following playlist.
High resolution audio files for the Pickr . playlist appear as follows:
- Tycho – Glider (24-bit, 96kHz)
- Daft Punk – Contact (24-bit, 88.2kHz)
- Carly Rae Jepsen – Cut To The Feeling (16-bit, 44.1kHz)
- Ariana Grande – Into You (24-bit, 44.1kHz)
- Mark Ronson – Uptown Funk (24-bit, 88.2kHz)
- Marvin Gaye – Ain’t No Mountain High Enough (24-bit, 96kHz)
- Charlie Puth – Done For Me (24-bit, 44.1kHz)
- Maroon 5 – Animals (24-bit, 96kHz)
- FKA Twigs – Two Weeks (24-bit, 44.1kHz)
- Muse – Madness (24-bit, 44.1kHz)
- Rage Against The Machine – Take The Power Back (24-bit, 44.1kHz)
- Deftones – Digital Bath (24-bit, 96kHz)
- David Bowie – Starman (24-bit, 96kHz)
- Paul Simon – You Can Call Me Al (24-bit, 96kHz)
- The Who – Baba O’Riley (24-bit, 96kHz)
- The Beatles – While My Guitar Gently Weeps (24-bit, 96kHz)
- Tatiana Samouil, David Lively – Clair de Lune (24-bit, 88.2kHz)
- Nigel Kennedy – Spring 5: Nymphs And Shepherds Dance (16-bit, 44.1kHz)
- Christian McBride – Fat Bach and Greens (24-bit, 96kHz)
- Ray Brown Trio – The Real Blues (24-bit, 88.2kHz)
- Dave Brubeck Quartet – Take Five (24-bit, 176.4kHz)
- Miles Davis – Flamenco Sketches (24-bit, 192kHz)
- Etta James – At Last (24-bit, 192kHz)
- Norah Jones – Come Away With Me (24-bit, 192kHz)
- Radiohead – Daydreaming (24-bit, 48kHz)
Pickr also offers a secondary sound test, the Pickr Bass Test, for testing extended bass in devices that may need it. This test, as well as previous Pickr sound tests, can be found here.