User-influenced/machine-controlled playback: the variPlay music app format for interactive recorded music

Lists

Paterson, Justin ORCID: https://orcid.org/0000-0001-7822-319X, Toulson, Rob and Hepworth-Sawyer, Russell (2019) User-influenced/machine-controlled playback: the variPlay music app format for interactive recorded music. Arts, 8 (3). p. 112. ISSN 2076-0752

[thumbnail of Paterson_Toulson_and_Hepworth-Sawyer_arts_2019_User-influencedmachine-controlled_playback_the_variPlay_music_app_format_for_interactive_recorded_music.pdf]

Preview

PDF
Paterson_Toulson_and_Hepworth-Sawyer_arts_2019_User-influencedmachine-controlled_playback_the_variPlay_music_app_format_for_interactive_recorded_music.pdf - Published Version
Available under License Creative Commons Attribution.
Download (6MB) | Preview

Official URL: https://doi.org/10.3390/arts8030112

Abstract

This paper concerns itself with an autoethnography of the five-year ‘variPlay’ project. This project drew from three consecutive rounds of research funding to develop an app format that could host both user interactivity to change the sound of recorded music in real-time, and a machine-driven mode that could autonomously remix, playing back a different version of a song upon every listen, or changing part way on user demand. The final funded phase involved commercialization, with the release of three apps using artists from the roster of project partner, Warner Music Group. The concept and operation of the app is discussed, alongside reflection on salient matters such as product development, music production, mastering, and issues encountered through the commercialization itself. The final apps received several thousand downloads around the world, in territories such as France, USA, and Mexico. Opportunities for future development are also presented.

Item Type:	Article
Identifier:	10.3390/arts8030112
Keywords:	interactive music; dynamic music; app; remix; automatic remix; commercialization; HCI; music production
Subjects:	Music > Music/audio technology Music > Record production
Related URLs:	Publisher
Depositing User:	Justin Paterson
Date Deposited:	03 Sep 2019 08:22
Last Modified:	06 Feb 2024 16:00
URI:	https://repository.uwl.ac.uk/id/eprint/6358

Downloads

Downloads per month over past year

Actions (login required)

View Item

References

(8Stem 2015) 8Stem. 2015. ‘‎8Stem Remix. Track Music Maker’. App Store, October. Available online: https://apps.apple.com/us/app/8stem-remix-track-music-maker/id1025280903 (accessed on 17 July 2019).
(Activision 2019) Activision. 2019. Guitar Hero Live the Game. Available online: https://www.guitarhero.com/uk/en/game (accessed on 17 July 2019).
(AHRC 2015) AHRC. 2015. Music App Is “Magic Meeting Technology”. Arts and Humanities Research Council. July 9. Available online: https://ahrc.ukri.org/newsevents/news/musicapp/ (accessed on 18 July 2019).
(Alferness 2003) Alferness, Anton Perry. 2003. Dynamically Changing Music. U.S. Patent US7078607B2, May 9. Available online: https://patents.google.com/patent/US7078607B2/en (accessed on 17 July 2019).
(Asympt Man 2018) Asympt Man. 2018. Chasing Infinity. Available online: https://apps.apple.com/gb/app/asympt-man-chasing-infinity/id1396470545 (accessed on 4 July 2019).
(Barnard et al. 2009) Barnard, David, Joachim Bondo, Dan Burcaw, David Kaneda, Craig Kemper, Tim Novikoff, Chris Parris. 2009. Epilogue: Reactive Music and Invisible Interfaces. In IPhone User Interface Design Projects. New York: Springer, pp. 235–38.
(Bartmanski and Woodward 2015) Bartmanski, Dominik, and Ian Woodward. 2015. The Vinyl: The Analogue Medium in the Age of Digital Reproduction. Journal of Consumer Culture 15: 3–27. doi:10.1177/1469540513488403.
(Bauer and Waldner 2013) Bauer, Christine, and Florian Waldner. 2013. Reactive Music: When User Behavior Affects Sounds in Real-Time. In CHI ’13 Extended Abstracts on Human Factors in Computing Systems. CHI EA ’13. New York: ACM, pp. 739–44. doi:10.1145/2468356.2468488.
(Beamz Interactive Inc. 2017) Beamz Interactive Inc. 2017. ‘Home’. Jam Studio VR. Available online: http://jamstudiovr.com/home.html (accessed on 17 July 2019).
(Beat Games 2018) Beat Games. 2018. Beat Saber-VR Rhythm Game. Available online: https://beatsaber.com/ (accessed on 17 July 2019).
(Bernhoft 2014) Bernhoft. 2014. Islander. App. Available online: http://www.hdthreesixty.com/bernhoft-islander.html (accessed on 12 July 2019).
(Big Beat Records 2019) Big Beat Records. 2019. WE ARE BIG BEAT. Official Website. Available online: https://www.wearebigbeat.com/stems (accessed on 17 July 2019).
(Björk 2011) Björk. 2011. ‎Biophilia. App. Available online: https://apps.apple.com/gb/app/bj%C3%B6rk-biophilia/id434122935 (accessed on 18 July 2019).
(Bogdan 2013) Bogdan, Georgiana. 2013. Is the Music Album App the next Game Changer? The Guardian, August 21. Sec. Media Network. Available online: https://www.theguardian.com/media-network/2013/aug/21/music-album-app (accessed on 24 June 2019).
(Chanan 1997) Chanan, Michael. 1997. Repeated Takes: A Short History of Recording and Its Effects on Music. London and New York: Verso.
(Chang 2009) Chang, Chiung-Wen (Michelle). 2009. “Return to Innocence”: In Search of Ethnic Identity in the Music of the Amis of Taiwan. College Music Symposium 49: 327–32.
(Coldcut 2015) Coldcut. 2015. ‎Ninja Jamm-DJ and Remix App. App Store. Available online: https://apps.apple.com/us/app/ninja-jamm-dj-and-remix-app/id533809331 (accessed on 17 July 2019).
(‘CPI Rates’ 2018) ‘CPI Rates’. 2018. Business of Apps (Blog). December 17. Available online: https://www.businessofapps.com/research/cost-per-install/ (accessed on 16 July 2019).
(Cycling ’74 n.d.) Cycling ’74. n.d. Mira iPad App for Max. Available online: https://cycling74.com/products/mira (accessed on 10 July 2019).
(Dredge 2014) Dredge, Stuart. 2014. Paul McCartney Re-Releases Five of His Classic Albums as iPad Apps. The Guardian, July 16, sec. Technology. Available online: https://www.theguardian.com/technology/2014/jul/16/
paul-mccartney-ipad-apps-albums (accessed on 19 July 2019).
(Enigma 1993) Enigma [Kuos]. 1993. Return To Innocence by Enigma on Amazon Music-Amazon.Co.Uk. Virgin. Available online: https://www.amazon.co.uk/Return-To-Innocence/dp/B001IRTL5Y/ref=sr_1_1?crid=2UIM2
THBVNCTM&keywords=return+to+innocence+enigma&qid=1566380569&s=gateway&sprefix=Return+to+Innocence+%2Caps%2C148&sr=8-1 (accessed on 21 August 2019).
(Entertainment Robotics 2013) Entertainment Robotics. 2013. MusicTiles. Available online: http://www.musictiles.com/ (accessed on 17 July 2019).
(Flurry 2019) Flurry. 2019. Flurry-App Analytics for Android & IOS. Available online: https://www.flurry.com/ (accessed on 16 July 2019).
(Gold 2012) Gold, Gwilym. 2012. Tender Metal. App. Available online: http://gwilymgold.com/ (accessed on 12 February 2014).
(Gunkel 2008) Gunkel, David J. 2008. Rethinking the Digital Remix: Mash-Ups and the Metaphysics of Sound Recording’. Popular Music and Society 31: 489–510.
(Harlow 2018) Harlow, Jack. 2018. ‎SUNDOWN. Atlantic Recording Corporation. Available online: https://music.apple.com/gb/album/sundown-single/1418204407 (accessed on 4 July 2019).
(Harmonix Music Systems, Inc. 2019) Harmonix Music Systems, Inc. 2019. Rock Band Rivals. Available online: http://rockband.com/ (accessed on 17 July 2019).
(Hestermann et al. 2018) Hestermann, Simon, Mario Seideneck, and Christoph Sladeczek. 2018. An Approach for Mastering Audio Objects. Paper presented at Audio Engineering Society Conference: 2018 AES International Conference on Spatial Reproduction-Aesthetics and Science, Tokyo, Japan, August 7–9. Available online: http://www.aes.org/e-lib/browse.cfm?elib=19631 (accessed on 17 July 2019).
(Hsu and Sosnick 2009) Hsu, William T., and Marc H. Sosnick. 2009. Evaluating Interactive Music Systems: An HCI Approach. In NIME. Pittsburgh: CiteSeerX, pp. 25–28.
(Jay Z 2004) Jay Z. 2004. The Black Album. Available online: https://open.spotify.com/album/4FWvo9oS4gRgHtAwDwUjiO (accessed on 17 July 2019).
(Johnson 1999) Johnson, Steven A. 1999. Interface Culture: How New Technology Transforms the Way We Create and Communicate, New ed. New York: Basic Books.
(Kania 2006) Kania, Andrew. 2006. Making Tracks: The Ontology of Rock Music. The Journal of Aesthetics and Art Criticism 64: 401–14.
(Kreps 2008) Kreps, Daniel. 2008. Radiohead Launch “Nude” Remix Contest. Rolling Stone (blog), April 1. Available online: https://www.rollingstone.com/music/music-news/radiohead-launch-nude-remix-contest-74495/ (accessed on 17 July 2019).
(McAlpine et al. 2009) McAlpine, Kenneth B., Matthew Bett, and James Scanlan. 2009. Approaches to Creating Real-Time Adaptive Music in Interactive Entertainment: A Musical Perspective. New York: Audio Engineering Society. Available online: http://www.aes.org/e-lib/browse.cfm?elib=15168 (accessed on 4 August 2015).
(McNally et al. 2019) McNally, Kirk, Toby Seay, and Paul Thompson. 2019. What the Masters Teach Us: Multitrack Audio Archives and Popular Music Education. The Bloomsbury Handbook of Popular Music Education: Perspectives and Practices 113.
(Melchior et al. 2011) Melchior, Frank, Uwe Michaelis, and Robert Steffens. 2011. Spatial Mastering-a New Concept for Spatial Sound Design in Object-Based Audio Scenes. In Proceedings of the International Computer Music Association. Huddersfield: University of Huddersfield. Available online: http://hdl.handle.net/2027/spo.bbp2372.2011.002 (accessed on 17 July 2019).
(Monroe 2016) Monroe, Jazz. 2016. Massive Attack Launch App Containing New Musi’. Pitchfork, January 21. Available online: https://pitchfork.com/news/61596-massive-attack-launch-app-containing-new-music/ (accessed on 17 July 2019).
‎(oiid 2015) oiid. 2015. App. Available online: https://apps.apple.com/no/app/oiid/id977918521 (accessed on 17 July 2019).
(Partridge 2007) Partridge, Christopher. 2007. King Tubby Meets the Upsetter at the Grass Roots of Dub: Some Thoughts on the Early History and Influence of Dub Reggae. London: Equinox Publishing, vol. 2.
(Paterson and Toulson 2016) Paterson, Justin L., and E. Rob Toulson. 2016. Interactive Digital Music: Enhancing Listener Engagement with Commercial Music. In Innovation in Music. Shoreham-by-Sea: Future Technology Press, vol. 2, pp. 193–209.
(Paterson and Toulson 2018a) Paterson, Justin L., and E. Rob Toulson. 2018a. VariPlay Record of the Day Guest Blog-BPI Innovation Hub. British Phonographic Industry (blog), August 13. Available online: https://www.bpi.co.uk/news-analysis/variplay-record-of-the-day-guest-blog-bpi-innovation-hub/ (accessed on 17 July 2019).
(Paterson and Toulson 2018b) Paterson, Justin L., and E. Rob Toulson. 2018b. VariPlay: The next Generation of Interactive Music. Paper presented at BPI Innovation Hub, London, UK, September 11.
(Paterson and Toulson 2018c) Paterson, Justin L., and E. Rob Toulson. 2018c. Interactive Recorded Music: Past, Present, and Future. In Audio Engineering Society Convention 145. New York City: Audio Engineering Society. Available online: http://www.aes.org/e-lib/browse.cfm?elib=19725 (accessed on 16 July 2019).
(Paterson et al. 2018) Paterson, Justin L., E. Rob Toulson, Defab1, and Vanessa Knight. 2018. Plan (Something Good) VariPlay. IOS App. Apple App Store. Available online: https://itunes.apple.com/gb/app/plan-defab1-vanessa-knight/id1413512922?mt=8 (accessed on) 17 July 2019.
(Paterson et al. 2019) Paterson, Justin L., E. Rob Toulson, and Ofenbach. 2019. Ofenbach variPlay. IOS App. Apple App Store. Available online: https://itunes.apple.com/us/app/ofenbach-variplay-rock-it/id1457847537?mt=8 (accessed on 16 July 2019).
(Paterson et al. 2018) Paterson, Justin L., E. Rob Toulson, and Ximena Sariñana. 2018. Ximena Sariñana variPlay. IOS App. Apple App Store. Available online: https://itunes.apple.com/us/app/ximena-sari%C3%B1ana-variplay/id1435482151?ls=1&mt=8 (accessed on 28 September 2018).
(Pike et al. 2016) Pike, Chris, Richard Taylor, Tom Parnell, and Frank Melchior. 2016. Object-Based 3D Audio Production for Virtual Reality Using the Audio Definition Model. In Proceedings of the Audio Engineering Society Conference: 2016 AES International Conference on Audio for Virtual and Augmented Reality. Los Angeles: Audio Engineering Society. Available online: http://www.aes.org/e-lib/browse.cfm?elib=18498 (accessed on 21 March 2017).
(Rambarran 2013) Rambarran, Shara. 2013. “99 Problems” but Danger Mouse Ain’t One: The Creative and Legal Difficulties of Brian Burton, “Author” of The Grey Album. Popular Musicology Online 3.
(Recording Academy: Producers and Engineers Wing 2018) Recording Academy: Producers & Engineers Wing. 2018. Delivery Recommendations For Recorded Music Projects. GRAMMY.Com. Available online: https://www.grammy.com/technical-guidelines (accessed on 12 July 2019).
(Redhead 2018) Redhead, Tracy. 2018. The Emerging Role of the Dynamic Music Producer. Paper presented at ACMC 2018, Perth, Australia, October 27–29. Available online: https://computermusic.org.au/conferences/acmc-2018/ (accessed on 17 July 2019).
(Reznor 2005) Reznor, Trent. 2005. NINRemixes.Com-Multitrack Sources. NIN Remixes. Available online: http://www.ninremixes.com/multitracks.php (accessed on 12 July 2019).
(Rundgren 1993) Rundgren, Todd. 1993. No World Order-TR-i-The 1st Interactive Music-Only Cd. Redwood City: Electronic Arts.
(Shakhovskoy and Toulson 2015) Shakhovskoy, Jonathan, and E. Rob Toulson. 2015. Future Music Formats: Evaluating the “Album App”. Journal on the Art of Record Production 10. Available online: https://www.arpjournal.com/asarpwp/future-music-formats-evaluating-the-album-app/ (accessed on 24 June 2019).
(Silva 2015) Silva, Steven. A. 2015. Object-Based Audio for Live TV Production. Paper presented at SMPTE 2015 Annual Technical Conference and Exhibition, Hollywood, CA, USA, October 26–29; pp. 1–9. doi:10.5594/M001650.
(Silzle et al. 2017) Silzle, Andreas, Michael Weitnauer, Olivier Warusfel, Werner Bleisteiner, Tilman Herberger, Nicolas Epain, Benjamin Duval. 2017. Orpheus Audio Project: Piloting an End-to-End Object-Based Audio Broadcasting Chain. Paper presented at IBC Conference, Amsterdam, The Netherlands, September 14–18. doi:10.1049/oap-ibc.2017.0022.
(Smith 2016) Smith, Sophy. 2016. Hip-Hop Turntablism, Creativity and Collaboration. New York City: Routledge.
(Stems-Music 2015) Stems-Music. 2015. Stems Is for DJs. Stems. 2015. Available online: http://www.stems-music.com/stems-is-for-djs/ (accessed on 5 August 2015).
(Subotnick 2001) Subotnick, Morton. 2001. Interactive Music Playback System Utilizing Gestures. U.S. Patent US20030159567A1, April 17. Available online: https://patents.google.com/patent/US20030159567A1/en (accessed on 17 July 2019).
(Sweet 2014) Sweet, Michael. 2014. Writing Interactive Music for Video Games: A Composer’s Guide, 1 ed. Upper Saddle River: Addison Wesley.
(TechCrunch 2010) TechCrunch. 2010. MXP4 Launches Social Music Gaming App Bopler Games so You Can “Play with Hits”. 2010. Available online: https://techcrunch.com/2011/04/18/mxp4-launches-social-music-gaming-app-bopler-games-so-you-can-play-with-hits/ (accessed on 17 July 2019).
(The Beatles 1968) The Beatles. 1968. The White Album. Audio CD. London: EMI.
(Toulson et al. 2014) Toulson, E. Rob, William Campbell, and Justin L. Paterson. 2014. Evaluating Harmonic and Intermodulation Distortion of Mixed Signals Processed with Dynamic Range Compression. In Innovation in Music. Shoreham-by-Sea: Future Technology Press, vol. 2013, pp. 224–46.
(Toulson and Paterson 2017) Toulson, E. Rob, and Justin L. Paterson. 2017. Cross-Fading between Audio Files. World Intellectual Property Organization WO2017068032A1, October 20. Available online: https://patents.google.com/patent/WO2017068032A1/en (accessed on 24 June 2019).
(Trinity College London 2019) Trinity College London. 2019. Trinity College London’s Music App Wins BETT Award for Best Educational App. Available online: https://www.trinitycollege.com/news/viewarticle.php?
id=549 (accessed on 18 July 2019).
(variPlay 2015) variPlay. 2015. ‘VariPlay’. VariPlay. Available online: http://www.variplay.co.uk (accessed on 18 July 2019).
(Wave 2017) Wave. 2017. ‘Wave’. Waves. Available online: http://wavexr.com (accessed on 17 July 2019).
(‘What Is CPI?’ 2019) ‘What Is CPI?’ 2019. TubeMogul (blog). Available online: https://www.tubemogul.com/glossary/cost-per-install/ (accessed on 16 July 2019).
(Woodcock et al. 2018) Woodcock, James, William J. Davies, Frank Melchior, and Trevor J. Cox. 2018. Elicitation of Expert Knowledge to Inform Object-Based Audio Rendering to Different Systems. J. Audio Eng. Soc 66: 44–59. doi:10.17743/jaes.2018.0001.
(xl recordings 2016) xl recordings. 2016. Sigur Rós-Route One. Available online: https://sigurros.com/routeone/ (accessed on 17 July 2019).
(Zak 2001) Zak, Albin J. 2001. The Poetics of Rock: Cutting Tracks, Making Records. Berkeley: University of California Press.
(Zheng et al. 2018) Zheng, Zibin, Shaoan Xie, Hong-Ning Dai, Xiangping Chen, and Huaimin Wang. 2018. Blockchain Challenges and Opportunities: A Survey. International Journal of Web and Grid Services 14: 352–75.

Tools

CORE (COnnecting REpositories)

The University of West London

User-influenced/machine-controlled playback: the variPlay music app format for interactive recorded music

Abstract

Downloads

Actions (login required)

Menu