US20170134872A1 - Volume control for audio/video devices - Google Patents

Volume control for audio/video devices Download PDF

Info

Publication number
US20170134872A1
US20170134872A1 US15/347,340 US201615347340A US2017134872A1 US 20170134872 A1 US20170134872 A1 US 20170134872A1 US 201615347340 A US201615347340 A US 201615347340A US 2017134872 A1 US2017134872 A1 US 2017134872A1
Authority
US
United States
Prior art keywords
volume
devices
rate
control
range
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
US15/347,340
Other versions
US10863267B2 (en
Inventor
Michael C. Silva
George T. Katsiris
Andrew R. Hamm
II Christopher R. Nelson
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Savant Systems Inc
Original Assignee
Savant Systems Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Savant Systems Inc filed Critical Savant Systems Inc
Priority to US15/347,340 priority Critical patent/US10863267B2/en
Assigned to SAVANT SYSTEMS, LLC reassignment SAVANT SYSTEMS, LLC ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: NELSON, CHRISTOPHER R., II, HAMM, ANDREW R., KATSIRIS, GEORGE T., SILVA, MICHAEL C.
Publication of US20170134872A1 publication Critical patent/US20170134872A1/en
Assigned to SAVANT SYSTEMS, INC. reassignment SAVANT SYSTEMS, INC. MERGER AND CHANGE OF NAME (SEE DOCUMENT FOR DETAILS). Assignors: SAVANT SYSTEMS, INC., SAVANT SYSTEMS, LLC
Assigned to PNC BANK, NATIONAL ASSOCIATION reassignment PNC BANK, NATIONAL ASSOCIATION SECURITY INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: CONSUMER LIGHTING (U.S.), LLC, SAVANT SYSTEMS, INC.
Application granted granted Critical
Publication of US10863267B2 publication Critical patent/US10863267B2/en
Assigned to SAVANT SYSTEMS, INC., Racepoint Energy, LLC, SAVANT TECHNOLOGIES LLC reassignment SAVANT SYSTEMS, INC. RELEASE BY SECURED PARTY (SEE DOCUMENT FOR DETAILS). Assignors: PNC BANK, NATIONAL ASSOCIATION
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R29/00Monitoring arrangements; Testing arrangements
    • H04R29/008Visual indication of individual signal levels
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04845Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04847Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04886Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16Sound input; Sound output
    • G06F3/165Management of the audio stream, e.g. setting of volume, audio stream path
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R27/00Public address systems
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00Circuits for transducers, loudspeakers or microphones
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2227/00Details of public address [PA] systems covered by H04R27/00 but not provided for in any of its subgroups
    • H04R2227/005Audio distribution systems for home, i.e. multi-room use
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2430/00Signal processing covered by H04R, not provided for in its groups
    • H04R2430/01Aspects of volume control, not necessarily automatic, in sound systems

Definitions

  • the present disclosure relates generally to audio/video (A/V) device control and more specifically to an improved volume control for A/V devices.
  • A/V audio/video
  • HVAC heating ventilation and cooling
  • Devices may be organized into a number of “rooms” that correspond to different interior portions of the building or exterior spaces associated with the building.
  • the home automation system may provide services in each of the rooms that utilize devices associated with the room. As part of these services, audio may be played in rooms by A/V devices. Depending on the configuration of the home automation system, the same audio may be played in each of the rooms, or different audio (e.g., from different audio sources) may be played in different ones of the rooms.
  • volume control presented in a graphical user interface (GUI).
  • GUI graphical user interface
  • the nature of such volume control may vary based on the type of volume adjustment natively supported by the A/V devices being used. For example, some A/V devices may natively support discrete volume adjustment, in which volume is defined by a number of discrete levels (e.g., 1, 2, 3 . . . 10; 1%, 2% 3% . . . 100%; etc.).
  • the volume control presented in the GUI may take the form of a slider. Feedback is provided by the location of the slider, with its initial position indicating the initial volume level in the room, and its final position indicating the new volume level.
  • A/V devices may natively support relative volume adjustment, in which volume of the A/V device is defined by incremental increases or decreases to an initial volume level.
  • the volume control presented in the GUI may take the form of + or ⁇ buttons, where the user can indicate whether the volume should be increased or decreased.
  • no feedback is provided in the GUI as to what the current volume level is, or what the new volume level will actually be. The user simply understands it will be something higher or lower than what it currently is, depending on how many times they press the + or ⁇ buttons.
  • a conventional discrete volume control may perform much better for making small adjustments to volume, as a user may, for example, simply tap a + or ⁇ button a single time to make a very small adjustment.
  • a master volume control may be provided in the GUI.
  • a master volume control (similar to a discrete volume control) may take the form of a slider. However, rather than represent volume level in a particular room, the position of the slider represents an “average” for multiple rooms, for example, an average of the positions of room-specific sliders for multiple rooms.
  • Such improved volume control may address the shortcomings of conventional discrete, relative and master volume controls, to provide an improved user experience.
  • Example techniques are provided for controlling volume of A/V devices using an improved volume control.
  • the volume control may be implemented as a slider, where the sliding element is temporarily slid in response to user input (e.g., touched and dragged by the user), and then automatically “snaps” back to the center of the slider's range when the user input ends (e.g., is released by the user). Movement of the element from the center is interpreted as a relative volume adjustment, with the rate of volume change being proportional to the distance between the center of the range and the temporary position of the element. An indicator is provided indicating the rate to provide feedback.
  • the volume control may be used as a master volume control to adjust volume of A/V devices in multiple (e.g., all) rooms of a system. Alternatively, the volume control may be used for room-specific volume adjustment to adjust volume of A/V devices of a corresponding room.
  • a control application executing on an electronic device (e.g., a remote control unit or a mobile device) of a home automation system presents a master volume control GUI implementing the above discussed techniques on a display screen (e.g., a touch screen) of the device for controlling one or more A/V devices.
  • the volume control is implanted as a form of slider, with a range extending between a minimum extent and a maximum extent, and an element (e.g., a button) that is slidable within the range.
  • the element is located at the center of the range by default, when not presently subject to user input (e.g., not touched and dragged on the touch screen), and is slidable to temporary positions located towards the minimum extent or the maximum extent of the range, when presently subject to user input (e.g., touch and dragged on the touch screen).
  • the element is automatically returned to the center of the range when the user input is removed (e.g., the touch is released on the touch screen).
  • control app In response to the element being slid to a temporary position located towards the minimum extent from the center of the range, the control app (or host software executing on a separate host controller in response to messages from the control app) issues control commands to decrease the volume of each of the one or more A/V devices at a rate proportional to a distance between the center of the range and the first temporary position. Likewise, in response to the element being slid to a second temporary position located towards the maximum extent from the center of the range, the control app (or host software executing on a separate host controller in response to messages from the control app) issues control commands to increase the volume of each of the one or more A/V devices at a rate proportional to a distance between the center of the range and the second temporary position.
  • the rates may be shown by an indicator (e.g., using a numerical value or graphical animation) in the GUI (e.g., an indictor pop-up attached to the element).
  • the volume control may be used with devices that natively support discreet volume adjustment by translating the applicable rate and an initial volume level to a discrete volume level to be applied to the A/V device.
  • the volume control may be used with devices that natively support relative volume adjustment by translating the applicable rate to a number of incremental increases or decreases to be applied to the A/V device.
  • FIG. 1 is a block diagram of an example architecture of a home automation system in which the volume control described herein may be implemented;
  • FIGS. 2A and 2B are screen shots of an example control GUI that includes a master volume control together with a number of room-specific volume controls;
  • FIG. 3 is a flow diagram of an example sequence of steps that may be executed by the control app to implement an improved volume control.
  • home automation system should be interpreted broadly to encompass various types of home control, “smart home”, and/or device control systems that may control devices (e.g., A/V devices, HVAC devices, lighting devices, security devices, electronic door locks, and/or other types of devices) of a building, such as a residential or commercial building.
  • devices e.g., A/V devices, HVAC devices, lighting devices, security devices, electronic door locks, and/or other types of devices
  • a home automation system may control a variety of different types of devices, or devices of only a particular type (e.g., only A/V devices).
  • A/V device refers to an electronic device that is capable of providing an audio output, and possibly a video output.
  • Devices such as receivers, amplifiers, televisions, media players, and the like are examples of A/V devices.
  • mobile device refers to an electronic device that executes a general-purpose operating system and is adapted to be transported on one's person.
  • Devices such as smartphones and tablet computers should be considered mobile devices.
  • Desktop computers, servers, or other primarily-stationary computing devices generally should not be considered mobile devices.
  • room refers to an interior portion of a building or an exterior space associated with a building, in which one or more services may be provided.
  • a room may correspond to a single physical room of the building, an aggregation of multiple physical rooms of the building, a sub-portion of a physical room of the building, or a particular delineation of exterior space associated with the building.
  • FIG. 1 is a block diagram of an example architecture of a home automation system in which the volume control described herein may be implemented.
  • a host controller 110 coupled to an in-home local area network (LAN) (e.g., a Wi-Fi network) 150 .
  • the host controller may include hardware components such as a processor, a memory and a storage device, which collectively store and execute host software 111 configured to monitor the control the operations of devices 112 - 122 , as well as to provide UI interpretation, system administration and monitoring, synchronization with cloud services 180 , remote controls 140 and mobile devices 160 , activity recording, activity prediction and other types of functionality.
  • LAN local area network
  • the host controller may include hardware components such as a processor, a memory and a storage device, which collectively store and execute host software 111 configured to monitor the control the operations of devices 112 - 122 , as well as to provide UI interpretation, system administration and monitoring, synchronization with cloud services 180 , remote controls 140 and mobile devices 160 , activity recording, activity prediction
  • the host controller 110 may maintain in its storage device a home database 130 that stores configuration information describing services the home automation system is configured to provide, user content such as scenes that are configured for a user of the home automation system, media content associated with a user of the home automation system (e.g., favorites), system state information indicating a present condition of the home automation system, as well as other types of data.
  • a home database 130 that stores configuration information describing services the home automation system is configured to provide, user content such as scenes that are configured for a user of the home automation system, media content associated with a user of the home automation system (e.g., favorites), system state information indicating a present condition of the home automation system, as well as other types of data.
  • the devices 112 - 122 of the home automation system may include audio devices 112 and video devices 114 (collectively A/V devices), such as receivers, amplifiers, televisions, media players, and the like; lighting devices 116 , such as lighting controllers, lamp modules, dimmer modules, switches, keypads, fan controllers and the like; security devices 118 , such as home monitors/cameras, motion sensors, home healthcare sensors, related controllers and the like; electronic door locks 120 and other types of motor or relay operated devices; HVAC devices 122 , such as thermostats, furnaces, air condition systems and the like; as well as other types of devices.
  • Each of the devices 112 - 122 may be associated with (i.e. configured to be used in connection with) a room.
  • the devices 112 - 122 may physically reside in the room with which they are associated, or reside elsewhere (e.g., a remote equipment rack) and simply be used with the associated room.
  • the devices 112 - 122 may be used by the home automation system to provide services, interacting in particular manners to provide activities in various rooms. Services may correspond to unique paths between devices. In the case of A/V devices, a service may involve unique audio and video paths from source devices to output devices that provide a viewing and/or listening activity. For example, a “Cable TV” service may correspond to paths between a cable box and a television that are utilized to provide a cable television activity.
  • the devices 112 - 122 of the home automation may have different communication capabilities.
  • the devices may include a LAN interface (e.g., a Wi-Fi adaptor) and communicate via the in-home LAN 150 (e.g., Wi-Fi).
  • some devices may only have ports or transceivers for wired or point-to-point wireless communication (e.g., RS-232, relay or general-purpose input/output (GPIO) ports, infrared (IR) transceivers, etc.) and may communicate using such ports.
  • some devices may include a LAN interface (e.g., a Wi-Fi interface), but not be configured to communicate directly with local devices, instead communicating via third party infrastructure 190 .
  • HVAC devices 122 are shown in FIG. 1 as an example of one type of device that may communicate in this manner, other types of devices 112 - 120 may alternatively use this method of communication, and vice versa.
  • the devices 112 - 122 of the home automation may have different control capabilities and may respond to different type of control commands.
  • some of the A/V devices 112 - 114 may be configured to natively support discrete volume adjustment, in which volume is defined by a number of discrete levels, and may respond to control commands that specify a particular volume level to adjust to.
  • Other A/V devices 112 - 114 may be configured to natively support relative volume adjustment, in which volume is defined by incremental increases or decreases to an initial volume level, and the may respond to control commands that specify when to apply increases or decreases.
  • a user may control the home automation system using a remote control 140 that communicates with the host controller 110 (and potentially directly with devices 112 - 122 ) through the in-home LAN 150 (e.g., via Wi-Fi) or via point-to-point wireless signals (e.g. via IR or radio frequency RF signals).
  • the remote control 140 may include hardware components such as a processor, a memory and a storage device, which store and execute software, including a control app 162 .
  • the control app 162 may generate a control GUI, among other functionality.
  • the remote control 140 may further include a display screen (e.g., a touch screen) for showing the control GUI, and input devices (e.g., a touch sensor of the touch screen, buttons, etc.) for receiving user input related to the control GUI.
  • a user may further control the home automation system using a mobile device 160 that communicates with the host controller 110 via the in-home LAN 150 or using a mobile data connection to the Internet 170 .
  • the mobile device 160 may include hardware components such as a processor, a memory and a storage device, which store which store and execute software, including a control app 162 . Similar to as on the remote control 140 , the control app 162 on the mobile device 160 may generate a control GUI, among other functionality.
  • the mobile device 160 may further include a display screen (e.g., a touch screen) for showing the control GUI, and an input device (e.g., a touch sensor of the touch screen) for receiving user input related to the control GUI.
  • the control GUI on either the remote control 140 or the mobile device 160 may include a special volume control implemented according to the techniques described herein.
  • the host device 110 and mobile device 160 may communicate via the Internet 170 with cloud services 180 and its host application program interfaces (APIs) 182 and mobile APIs 184 .
  • the cloud services 180 may provide remote access to home automation control, a persistent backup of the home database 130 , interfaces to third party infrastructure 190 (via third party adaptors 188 ), user profiles and usage tracking (storing data in user database 189 ), a mechanism for over-the-air updates, host crash reporting, and license management, among other functions.
  • the control app 162 executing on the remote control unit 140 or mobile device 160 may implement an improved volume control for controlling volume of A/V devices 112 - 114 .
  • the volume control may be displayed in a control GUI on the display screen (e.g., a touch screen) of the remote control unit 140 or mobile device 160 .
  • the control app 162 (or the host software 111 in response to messages from the control app 162 ) may issue control commands to A/V devices that include discrete volume levels or a number of incremental increases or incremental decreases to an initial volume, depending on their native capabilities.
  • the volume control may take the form of a master volume control that controls the volume of A/V device of multiple (e.g. all) rooms in the home automation system.
  • Such master volume control may be displayed in the control GUI together with a number of room-specific volume controls that each control volume of A/V devices of a corresponding room.
  • the room-specific volume controls may be implemented as conventional discrete or relative controls, or incorporating the techniques described herein.
  • FIGS. 2A and 2B are screen shots 200 , 202 of an example control GUI that includes a master volume control 210 together with a number of room-specific volume controls 220 - 240 .
  • the master volume control 210 is implemented as an improved volume control using the techniques described herein, and includes an element (e.g., a button) 212 that is slidable within a range between a minimum extent 214 and a maximum extent 216 .
  • the element 212 is located at the center of the range (as shown in FIG. 2A ) by default, when not presently subject to user input (e.g., a touch and drag by the user on the touch screen).
  • the element 212 When presently subject to user input (e.g., when touched and dragged by the user on the touch screen) the element 212 is slidable to temporary positions located towards the minimum extent 214 (as shown in FIG. 2B ) or the maximum extent 216 .
  • the control app 162 causes the element 212 to automatically return (“snap” back) to the center of the range (back to shown in FIG. 2A ) when the user input is removed (e.g., the element is released by the user on the touch screen).
  • Movement of the element 212 from the center of the range is interpreted by the control app 162 as a relative volume adjustment, with a rate of volume change from an initial volume being proportional to the distance between the center of the range and the temporary position of the element 212 .
  • the rate of volume change is translated by the control app 162 (or is provided to the host software 111 , and then translated by the host software 111 , depending on the implementation) into either a discrete volume level for A/V devices that natively support discrete volume adjustment, or a number of incremental increases or incremental decrease to an initial volume for A/V devices that natively support relative volume adjustment.
  • the discrete volume level or number of incremental increases or incremental decrease is supplied to the A/V devices in control commands (e.g., transmitted over the in-home LAN 150 , or otherwise communicated to the A/V devices).
  • An indicator 218 is provided in the volume control indicating the rate of volume change, to provide feedback to the user.
  • the indicator may take the form of a pop-up box attached to the element 212 , and show a numerical value quantifying the rate of volume change (e.g., “ ⁇ 2” in FIG. 2B ).
  • the indicator may be a graphical animation that indicates the rate of volume change (e.g., a graphic, a color change, etc.)
  • FIG. 3 is a flow diagram of an example sequence of steps that may be executed by the control app 162 (alone, or in some implementations in conjunction with the host software 111 ) to implement an improved volume control.
  • the control app 162 presents the improved volume control (e.g., as a master volume control) in a control GUI on a display screen (e.g., a touch screen) of a remote control 140 or mobile device 160 .
  • the control app 162 detects user input (e.g., a touch and drag by the user on the touch screen) and slides the element 212 to a temporary position towards the minimum extent 214 or the maximum extent 216 from the center of the range to follow the user input.
  • the control app 162 determines a rate of volume decrease.
  • the control app 162 (or host software 111 in response to messages from the control app 162 , depending on the implementation) calculates a discrete volume level for each A/V device 112 - 114 that natively support discrete volume adjustment, based on the rate of volume decrease and an initial volume level of the A/V device, or a number of incremental decreases to an initial volume for each A/V device that natively support relative volume adjustment, based on the rate of volume decrease and a mapping of rates to numbers of incremental volume changes.
  • control app 162 (or host software 111 , depending on the implementation) issues control commands to each of the A/V devices that include the calculated discrete volume level or indication of the incremental decreases, to effectively decrease their volume at the rate of volume decrease.
  • the control app 162 determines a rate of volume increase.
  • the control app 162 (or host software 111 in response to messages from the control app 162 , depending on the implementation) calculates a discrete volume level for each A/V device that natively support discrete volume adjustment, based on the rate of volume increase and an initial volume level of the device, or a number of incremental increases to an initial volume for each A/V device that natively support relative volume adjustment, based on the rate of volume increase and a mapping of rates to numbers of incremental volume changes.
  • the control app 162 (or host software 111 depending on the implementation) issues control commands to each of the A/V devices that include the discrete volume level or indication of the incremental increases, to effectively increase their at the rate of volume increase.
  • step 390 which may be performed simultaneously to steps 330 - 350 or 360 - 380 , the control app 162 updates an indictor of the volume control of the GUI to provide feedback regarding the rate of volume increase or decrease (e.g., with a numerical value or graphical animation). By looking to the indicator, the user may discern how rapidly they are ramping volume up or down, and moderate their movement of the element 212 from the center of the range accordingly.
  • volume control for A/V devices. While embodiments discussed above involve use of the volume control as a room-specific volume control or as a master volume control in a home automation system that includes a number of rooms, it should be understood that the volume control may be used as an individual device volume control (e.g., absent a full home automation system), or as another type of volume control, as part of a variety of different types of systems or devices.
  • volume control may be implemented in a GUI on a display screen of a mobile device or remote control unit
  • the volume control may not be a part of a GUI on a display screen, but instead may be implemented as a physical control.
  • a physical control may include a physical element that may be grasp by the user and mechanically slid in a track over a range. The physical element may be spring loaded to return to the center of the range when released by the user.
  • a physical implementation of the volume control may operate similarly to an implementation in a GUI.
  • volume control that is implemented as a form of slider, with an element (e.g., a button) that is slidable within a range
  • the volume control may also be implemented using other forms of controls that do not rely upon linear motion.
  • the volume control may be implemented as a form of a knob, where the knob is rotatable within a rotational range that extends between a minimum extent and a maximum extent.
  • the knob may be oriented by default to a certain position (e.g., a center position) of the rotational range, and configured to automatically return to this position when released by the user.
  • control commands may be issued to decrease or increase the volume of each of the one or more A/V devices at a rate proportional to the degree of rotation in the respective direction.
  • volume control may allow an element to remain at the same position when user input is removed.
  • distance or rotation, as the case may be
  • software implementations may include electronic device-executable instructions (e.g., computer-executable instructions) stored in a non-transitory electronic device-readable medium (e.g., a non-transitory computer-readable medium), such as a volatile or persistent memory, a hard-disk, a compact disk (CD), or other tangible medium.
  • Hardware implementations may include logic circuits, application specific integrated circuits, and/or other types of hardware components.
  • combined software/hardware implementations may include both electronic device-executable instructions stored in a non-transitory electronic device-readable medium, as well as one or more hardware components, for example, processors, memories, etc.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • General Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Multimedia (AREA)
  • Selective Calling Equipment (AREA)
  • Otolaryngology (AREA)

Abstract

Example techniques are provided for controlling volume of A/V devices using an improved volume control. The volume control may be implemented as a slider, where the sliding element is temporarily slid in response to user input (e.g., touched and dragged by the user), but then automatically “snaps” back to the center of the slider's range when the user input ends (e.g., is released by the user). Movement of the element from the center is interpreted as a relative volume adjustment, with the rate of volume change being proportional to the distance between the center of the range and the temporary position of the element. An indicator is provided indicating the rate, to provide user feedback. The volume control may be utilized as a master volume control in a home automation system.

Description

    RELATED APPLICATIONS
  • The present application claims the benefit of U.S. Provisional Patent Application No. 62/253,472, filed on Nov. 10, 2015 by Michael C. Silva et al., titled “Volume Control for Audio/Video Devices”, the content of which are incorporated by reference herein in their entirety.
  • BACKGROUND
  • Technical Field
  • The present disclosure relates generally to audio/video (A/V) device control and more specifically to an improved volume control for A/V devices.
  • Background Information
  • Home automation systems are becoming increasingly popular in both residential and commercial buildings. Such systems may be capable of controlling, switching data between, and otherwise interacting audio/video (A/V) devices (e.g., receivers, amplifiers, televisions, media players, etc.), as well as a wide variety of other types of devices, such as lighting devices, heating ventilation and cooling (HVAC) devices, security devices, electronic door locks, etc. Devices may be organized into a number of “rooms” that correspond to different interior portions of the building or exterior spaces associated with the building. The home automation system may provide services in each of the rooms that utilize devices associated with the room. As part of these services, audio may be played in rooms by A/V devices. Depending on the configuration of the home automation system, the same audio may be played in each of the rooms, or different audio (e.g., from different audio sources) may be played in different ones of the rooms.
  • Many home automation systems allow a user to control the volume of the audio being played in an individual room using a volume control presented in a graphical user interface (GUI). The nature of such volume control may vary based on the type of volume adjustment natively supported by the A/V devices being used. For example, some A/V devices may natively support discrete volume adjustment, in which volume is defined by a number of discrete levels (e.g., 1, 2, 3 . . . 10; 1%, 2% 3% . . . 100%; etc.). In such cases, the volume control presented in the GUI may take the form of a slider. Feedback is provided by the location of the slider, with its initial position indicating the initial volume level in the room, and its final position indicating the new volume level.
  • In other cases, A/V devices may natively support relative volume adjustment, in which volume of the A/V device is defined by incremental increases or decreases to an initial volume level. In such cases, the volume control presented in the GUI may take the form of + or − buttons, where the user can indicate whether the volume should be increased or decreased. Typically, no feedback is provided in the GUI as to what the current volume level is, or what the new volume level will actually be. The user simply understands it will be something higher or lower than what it currently is, depending on how many times they press the + or − buttons.
  • While widely used to control volume in specific rooms, conventional discrete and relative volume controls suffer a number of shortcomings. With a conventional discrete volume control, a user may have difficulty making fine adjustments to volume. When many discrete levels are mapped to a relatively small slider, even a small movement of the slider may cause a dramatic adjustment to the volume (e.g., increasing it or decreasing it by many levels). This may cause a user to easily “overshoot” their intended target, requiring repeated, often “fiddly”, adjustments to obtain a desired volume level. A conventional relative volume control may perform much better for making small adjustments to volume, as a user may, for example, simply tap a + or − button a single time to make a very small adjustment. However, with a conventional relative volume control, a user may have difficulty making large adjustments to volume. If the user desires to make a significant adjustment, they be required to tap + or − buttons a great number of times. The need to press these buttons over and over again may lead to a frustrating user experience.
  • In addition to adjusting volume in individual rooms, some home automation systems allow a user to simultaneously adjust the volume of audio being played in all rooms. In such cases, a master volume control may be provided in the GUI. A master volume control (similar to a discrete volume control) may take the form of a slider. However, rather than represent volume level in a particular room, the position of the slider represents an “average” for multiple rooms, for example, an average of the positions of room-specific sliders for multiple rooms.
  • While a conventional master volume control may work acceptably for systems where all A/V device natively supported discrete volume adjustment, they typically have difficulty (or do not work at all) in systems that include A/V device that only supported relative volume adjustment. Absent feedback from an A/V device regarding what the initial volume level is, an accurate “average” cannot readily be calculated. Accordingly, the position of the slider in the in the master volume control may be misleading.
  • Accordingly, there is a need for an improved volume control for A/V devices that may be used as a room-specific volume control or as a master volume control. Such improved volume control may address the shortcomings of conventional discrete, relative and master volume controls, to provide an improved user experience.
  • SUMMARY
  • Example techniques are provided for controlling volume of A/V devices using an improved volume control. The volume control may be implemented as a slider, where the sliding element is temporarily slid in response to user input (e.g., touched and dragged by the user), and then automatically “snaps” back to the center of the slider's range when the user input ends (e.g., is released by the user). Movement of the element from the center is interpreted as a relative volume adjustment, with the rate of volume change being proportional to the distance between the center of the range and the temporary position of the element. An indicator is provided indicating the rate to provide feedback. The volume control may be used as a master volume control to adjust volume of A/V devices in multiple (e.g., all) rooms of a system. Alternatively, the volume control may be used for room-specific volume adjustment to adjust volume of A/V devices of a corresponding room.
  • In one specific example embodiment, a control application (app) executing on an electronic device (e.g., a remote control unit or a mobile device) of a home automation system presents a master volume control GUI implementing the above discussed techniques on a display screen (e.g., a touch screen) of the device for controlling one or more A/V devices. The volume control is implanted as a form of slider, with a range extending between a minimum extent and a maximum extent, and an element (e.g., a button) that is slidable within the range. The element is located at the center of the range by default, when not presently subject to user input (e.g., not touched and dragged on the touch screen), and is slidable to temporary positions located towards the minimum extent or the maximum extent of the range, when presently subject to user input (e.g., touch and dragged on the touch screen). The element is automatically returned to the center of the range when the user input is removed (e.g., the touch is released on the touch screen). In response to the element being slid to a temporary position located towards the minimum extent from the center of the range, the control app (or host software executing on a separate host controller in response to messages from the control app) issues control commands to decrease the volume of each of the one or more A/V devices at a rate proportional to a distance between the center of the range and the first temporary position. Likewise, in response to the element being slid to a second temporary position located towards the maximum extent from the center of the range, the control app (or host software executing on a separate host controller in response to messages from the control app) issues control commands to increase the volume of each of the one or more A/V devices at a rate proportional to a distance between the center of the range and the second temporary position. The rates may be shown by an indicator (e.g., using a numerical value or graphical animation) in the GUI (e.g., an indictor pop-up attached to the element). The volume control may be used with devices that natively support discreet volume adjustment by translating the applicable rate and an initial volume level to a discrete volume level to be applied to the A/V device. Likewise, the volume control may be used with devices that natively support relative volume adjustment by translating the applicable rate to a number of incremental increases or decreases to be applied to the A/V device.
  • It should be understood that a variety of additional features and alternative embodiments may be implemented other than those discussed in this Summary. This Summary is intended simply as a brief introduction to the reader, and does not indicate or imply that the examples mentioned herein cover all aspects of the disclosure, or are necessary or essential aspects of the disclosure.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • The description below refers to the accompanying drawings of example embodiments, of which:
  • FIG. 1 is a block diagram of an example architecture of a home automation system in which the volume control described herein may be implemented;
  • FIGS. 2A and 2B are screen shots of an example control GUI that includes a master volume control together with a number of room-specific volume controls; and
  • FIG. 3 is a flow diagram of an example sequence of steps that may be executed by the control app to implement an improved volume control.
  • DETAILED DESCRIPTION Definitions
  • As used herein, the term “home automation system” should be interpreted broadly to encompass various types of home control, “smart home”, and/or device control systems that may control devices (e.g., A/V devices, HVAC devices, lighting devices, security devices, electronic door locks, and/or other types of devices) of a building, such as a residential or commercial building. A home automation system may control a variety of different types of devices, or devices of only a particular type (e.g., only A/V devices).
  • As used herein, the term “A/V device” refers to an electronic device that is capable of providing an audio output, and possibly a video output. Devices such as receivers, amplifiers, televisions, media players, and the like are examples of A/V devices.
  • As used herein, the term “mobile device” refers to an electronic device that executes a general-purpose operating system and is adapted to be transported on one's person. Devices such as smartphones and tablet computers should be considered mobile devices. Desktop computers, servers, or other primarily-stationary computing devices generally should not be considered mobile devices.
  • As use herein, the term “room” refers to an interior portion of a building or an exterior space associated with a building, in which one or more services may be provided. A room may correspond to a single physical room of the building, an aggregation of multiple physical rooms of the building, a sub-portion of a physical room of the building, or a particular delineation of exterior space associated with the building.
  • An Example Home Automation System
  • FIG. 1 is a block diagram of an example architecture of a home automation system in which the volume control described herein may be implemented. At the core of the system is a host controller 110 coupled to an in-home local area network (LAN) (e.g., a Wi-Fi network) 150. The host controller may include hardware components such as a processor, a memory and a storage device, which collectively store and execute host software 111 configured to monitor the control the operations of devices 112-122, as well as to provide UI interpretation, system administration and monitoring, synchronization with cloud services 180, remote controls 140 and mobile devices 160, activity recording, activity prediction and other types of functionality.
  • The host controller 110 may maintain in its storage device a home database 130 that stores configuration information describing services the home automation system is configured to provide, user content such as scenes that are configured for a user of the home automation system, media content associated with a user of the home automation system (e.g., favorites), system state information indicating a present condition of the home automation system, as well as other types of data.
  • The devices 112-122 of the home automation system may include audio devices 112 and video devices 114 (collectively A/V devices), such as receivers, amplifiers, televisions, media players, and the like; lighting devices 116, such as lighting controllers, lamp modules, dimmer modules, switches, keypads, fan controllers and the like; security devices 118, such as home monitors/cameras, motion sensors, home healthcare sensors, related controllers and the like; electronic door locks 120 and other types of motor or relay operated devices; HVAC devices 122, such as thermostats, furnaces, air condition systems and the like; as well as other types of devices. Each of the devices 112-122 may be associated with (i.e. configured to be used in connection with) a room. The devices 112-122 may physically reside in the room with which they are associated, or reside elsewhere (e.g., a remote equipment rack) and simply be used with the associated room.
  • The devices 112-122 may be used by the home automation system to provide services, interacting in particular manners to provide activities in various rooms. Services may correspond to unique paths between devices. In the case of A/V devices, a service may involve unique audio and video paths from source devices to output devices that provide a viewing and/or listening activity. For example, a “Cable TV” service may correspond to paths between a cable box and a television that are utilized to provide a cable television activity.
  • Depending on the implementation, the devices 112-122 of the home automation may have different communication capabilities. For example, at least some of the devices may include a LAN interface (e.g., a Wi-Fi adaptor) and communicate via the in-home LAN 150 (e.g., Wi-Fi). Likewise, some devices may only have ports or transceivers for wired or point-to-point wireless communication (e.g., RS-232, relay or general-purpose input/output (GPIO) ports, infrared (IR) transceivers, etc.) and may communicate using such ports. Further, some devices may include a LAN interface (e.g., a Wi-Fi interface), but not be configured to communicate directly with local devices, instead communicating via third party infrastructure 190. It should be understood that while HVAC devices 122 are shown in FIG. 1 as an example of one type of device that may communicate in this manner, other types of devices 112-120 may alternatively use this method of communication, and vice versa.
  • Furthermore, depending on the implementation, the devices 112-122 of the home automation may have different control capabilities and may respond to different type of control commands. For example, some of the A/V devices 112-114 may be configured to natively support discrete volume adjustment, in which volume is defined by a number of discrete levels, and may respond to control commands that specify a particular volume level to adjust to. Other A/V devices 112-114 may be configured to natively support relative volume adjustment, in which volume is defined by incremental increases or decreases to an initial volume level, and the may respond to control commands that specify when to apply increases or decreases.
  • A user may control the home automation system using a remote control 140 that communicates with the host controller 110 (and potentially directly with devices 112-122) through the in-home LAN 150 (e.g., via Wi-Fi) or via point-to-point wireless signals (e.g. via IR or radio frequency RF signals). The remote control 140 may include hardware components such as a processor, a memory and a storage device, which store and execute software, including a control app 162. The control app 162 may generate a control GUI, among other functionality. The remote control 140 may further include a display screen (e.g., a touch screen) for showing the control GUI, and input devices (e.g., a touch sensor of the touch screen, buttons, etc.) for receiving user input related to the control GUI.
  • A user may further control the home automation system using a mobile device 160 that communicates with the host controller 110 via the in-home LAN 150 or using a mobile data connection to the Internet 170. The mobile device 160 may include hardware components such as a processor, a memory and a storage device, which store which store and execute software, including a control app 162. Similar to as on the remote control 140, the control app 162 on the mobile device 160 may generate a control GUI, among other functionality. The mobile device 160 may further include a display screen (e.g., a touch screen) for showing the control GUI, and an input device (e.g., a touch sensor of the touch screen) for receiving user input related to the control GUI. As explained further below, the control GUI on either the remote control 140 or the mobile device 160 may include a special volume control implemented according to the techniques described herein.
  • The host device 110 and mobile device 160 may communicate via the Internet 170 with cloud services 180 and its host application program interfaces (APIs) 182 and mobile APIs 184. The cloud services 180 may provide remote access to home automation control, a persistent backup of the home database 130, interfaces to third party infrastructure 190 (via third party adaptors 188), user profiles and usage tracking (storing data in user database 189), a mechanism for over-the-air updates, host crash reporting, and license management, among other functions.
  • A Volume Control for A/V Devices
  • The control app 162 executing on the remote control unit 140 or mobile device 160 may implement an improved volume control for controlling volume of A/V devices 112-114. The volume control may be displayed in a control GUI on the display screen (e.g., a touch screen) of the remote control unit 140 or mobile device 160. In response to user input on the volume control in the control GUI, the control app 162 (or the host software 111 in response to messages from the control app 162) may issue control commands to A/V devices that include discrete volume levels or a number of incremental increases or incremental decreases to an initial volume, depending on their native capabilities.
  • In one implementation, the volume control may take the form of a master volume control that controls the volume of A/V device of multiple (e.g. all) rooms in the home automation system. Such master volume control may be displayed in the control GUI together with a number of room-specific volume controls that each control volume of A/V devices of a corresponding room. The room-specific volume controls may be implemented as conventional discrete or relative controls, or incorporating the techniques described herein.
  • FIGS. 2A and 2B are screen shots 200, 202 of an example control GUI that includes a master volume control 210 together with a number of room-specific volume controls 220-240. The master volume control 210 is implemented as an improved volume control using the techniques described herein, and includes an element (e.g., a button) 212 that is slidable within a range between a minimum extent 214 and a maximum extent 216. The element 212 is located at the center of the range (as shown in FIG. 2A) by default, when not presently subject to user input (e.g., a touch and drag by the user on the touch screen). When presently subject to user input (e.g., when touched and dragged by the user on the touch screen) the element 212 is slidable to temporary positions located towards the minimum extent 214 (as shown in FIG. 2B) or the maximum extent 216. The control app 162 causes the element 212 to automatically return (“snap” back) to the center of the range (back to shown in FIG. 2A) when the user input is removed (e.g., the element is released by the user on the touch screen).
  • Movement of the element 212 from the center of the range is interpreted by the control app 162 as a relative volume adjustment, with a rate of volume change from an initial volume being proportional to the distance between the center of the range and the temporary position of the element 212. The rate of volume change is translated by the control app 162 (or is provided to the host software 111, and then translated by the host software 111, depending on the implementation) into either a discrete volume level for A/V devices that natively support discrete volume adjustment, or a number of incremental increases or incremental decrease to an initial volume for A/V devices that natively support relative volume adjustment. The discrete volume level or number of incremental increases or incremental decrease is supplied to the A/V devices in control commands (e.g., transmitted over the in-home LAN 150, or otherwise communicated to the A/V devices). An indicator 218 is provided in the volume control indicating the rate of volume change, to provide feedback to the user. The indicator may take the form of a pop-up box attached to the element 212, and show a numerical value quantifying the rate of volume change (e.g., “−2” in FIG. 2B). Alternatively, the indicator may be a graphical animation that indicates the rate of volume change (e.g., a graphic, a color change, etc.)
  • FIG. 3 is a flow diagram of an example sequence of steps that may be executed by the control app 162 (alone, or in some implementations in conjunction with the host software 111) to implement an improved volume control. At step 310, the control app 162 presents the improved volume control (e.g., as a master volume control) in a control GUI on a display screen (e.g., a touch screen) of a remote control 140 or mobile device 160. At step 320, the control app 162 detects user input (e.g., a touch and drag by the user on the touch screen) and slides the element 212 to a temporary position towards the minimum extent 214 or the maximum extent 216 from the center of the range to follow the user input.
  • At step 330, in response to the element 212 being slid to a temporary position located towards the minimum extent 214 from the center of the range, the control app 162 determines a rate of volume decrease. At step 340, the control app 162 (or host software 111 in response to messages from the control app 162, depending on the implementation) calculates a discrete volume level for each A/V device 112-114 that natively support discrete volume adjustment, based on the rate of volume decrease and an initial volume level of the A/V device, or a number of incremental decreases to an initial volume for each A/V device that natively support relative volume adjustment, based on the rate of volume decrease and a mapping of rates to numbers of incremental volume changes. Then, at step 350, the control app 162 (or host software 111, depending on the implementation) issues control commands to each of the A/V devices that include the calculated discrete volume level or indication of the incremental decreases, to effectively decrease their volume at the rate of volume decrease.
  • Alternatively, at step 360, in response to the element 212 being slid to a second temporary position located towards the maximum extent 216 from the center of the range, the control app 162 determines a rate of volume increase. At step 370, the control app 162 (or host software 111 in response to messages from the control app 162, depending on the implementation) calculates a discrete volume level for each A/V device that natively support discrete volume adjustment, based on the rate of volume increase and an initial volume level of the device, or a number of incremental increases to an initial volume for each A/V device that natively support relative volume adjustment, based on the rate of volume increase and a mapping of rates to numbers of incremental volume changes. Then at step 380, the control app 162 (or host software 111 depending on the implementation) issues control commands to each of the A/V devices that include the discrete volume level or indication of the incremental increases, to effectively increase their at the rate of volume increase.
  • At step 390, which may be performed simultaneously to steps 330-350 or 360-380, the control app 162 updates an indictor of the volume control of the GUI to provide feedback regarding the rate of volume increase or decrease (e.g., with a numerical value or graphical animation). By looking to the indicator, the user may discern how rapidly they are ramping volume up or down, and moderate their movement of the element 212 from the center of the range accordingly.
  • CONCLUSIONS
  • It should be understood that various adaptations and modifications may be made to the above discussed improved volume control for A/V devices. While embodiments discussed above involve use of the volume control as a room-specific volume control or as a master volume control in a home automation system that includes a number of rooms, it should be understood that the volume control may be used as an individual device volume control (e.g., absent a full home automation system), or as another type of volume control, as part of a variety of different types of systems or devices.
  • Further, while embodiments discussed above may display of the volume control in a GUI on a display screen of a mobile device or remote control unit, it should be understood that the volume control may be implemented in a GUI on a display screen of a wide range of other type of electronic devices. Alternatively, the volume control may not be a part of a GUI on a display screen, but instead may be implemented as a physical control. Such a physical control may include a physical element that may be grasp by the user and mechanically slid in a track over a range. The physical element may be spring loaded to return to the center of the range when released by the user. In many other respects, a physical implementation of the volume control may operate similarly to an implementation in a GUI.
  • Likewise, while embodiments discussed above involve a volume control that is implemented as a form of slider, with an element (e.g., a button) that is slidable within a range, it should be understood that the volume control may also be implemented using other forms of controls that do not rely upon linear motion. For example, the volume control may be implemented as a form of a knob, where the knob is rotatable within a rotational range that extends between a minimum extent and a maximum extent. The knob may be oriented by default to a certain position (e.g., a center position) of the rotational range, and configured to automatically return to this position when released by the user. In response to the knob being rotated to a temporary position located towards the minimum extent or the maximum extent, control commands may be issued to decrease or increase the volume of each of the one or more A/V devices at a rate proportional to the degree of rotation in the respective direction.
  • Further, while embodiments discussed above involve an element of a volume control that automatically returns to the center of a range when the user input is removed, it should be understood that the volume control also may allow an element to remain at the same position when user input is removed. In such implementations, distance (or rotation, as the case may be) may be measured from the prior position of an element of the volume control, rather than a predefined center.
  • Additionally, while it is discussed above that calculations and other processing operations utilized to implement the volume control are performed by the control app 162 (or host software 111), it should be understood that operations may be performed by other software, in hardware or using various combinations thereof. In general, software implementations may include electronic device-executable instructions (e.g., computer-executable instructions) stored in a non-transitory electronic device-readable medium (e.g., a non-transitory computer-readable medium), such as a volatile or persistent memory, a hard-disk, a compact disk (CD), or other tangible medium. Hardware implementations may include logic circuits, application specific integrated circuits, and/or other types of hardware components. Further, combined software/hardware implementations may include both electronic device-executable instructions stored in a non-transitory electronic device-readable medium, as well as one or more hardware components, for example, processors, memories, etc.
  • Above all, it should be understood that the above embodiments are meant to be taken only by way of example. What is claimed is:

Claims (25)

1. A method for controlling volume of one or more audio/video (A/V) devices, comprising:
presenting in a graphical user interface on a display screen of an electronic device a volume control that includes:
a range having a minimum extent, a maximum extent and a center, and
an element that is slidable within the range, the element located at the center of the range by default when not presently subject to user input, and slidable to temporary positions located towards the minimum extent or the maximum extent of the range when presently subject to user input, the element to automatically return to the center of the range when the user input is removed; and
in response to the element being slid to a first temporary position located towards the minimum extent from the center of the range, decreasing, by software executing on the electronic device or another electronic device, the volume of each of the one or more A/V devices from a respective initial volume at a first rate, the first rate being proportional to a distance between the center of the range and the first temporary position; and
in response to the element being slid to a second temporary position located towards the maximum extent from the center of the range, increasing, by software executing on the electronic device or another electronic device, the volume of each of the one or more A/V devices from the respective initial volume at a second rate, the second rate being proportional to a distance between the center of the range and the second temporary position.
2. The method of claim 1, wherein the volume control further include:
an indicator that is shown at least when the element is slid to the first temporary position or the second temporary position, the indicator indicating the first rate at which the volume of the one or more A/V devices is decreasing or the second rate at which the volume of the of the one or more A/V devices is increasing.
3. The method of claim 2, wherein the indicator includes a numerical value indicating the first rate at which the volume of the one or more A/V devices is decreasing or the second rate at which the volume of the of the one or more A/V devices is increasing.
4. The method of claim 2, wherein the indicator includes a graphical animation indicating the first rate at which the volume of the one or more A/V devices is decreasing or the second rate at which the volume of the of the one or more A/V devices is increasing.
5. The method of claim 1, wherein the one or more A/V devices are a plurality of A/V devices, and the decreasing the volume decreases the volume of each of the plurality of A/V devices at the same first rate, and the increasing the volume increase the volume of each of the plurality of devices at the same second rate.
6. The method of claim 5, wherein the two or more of the plurality of A/V devices have different initial volumes.
7. The method of claim 5, wherein the plurality of A/V devices are organized into a plurality of rooms, the graphical user interface includes a plurality of room-specific volume controls that each control volume of A/V devices of a corresponding room, and the volume control is a master volume control that controls volume of A/V devices of all the plurality of rooms.
8. The method of claim 1, where at least one of the one or more A/V devices natively supports discrete volume control, and the software executing on the electronic device or another electronic device calculates a first discrete level that is supplied to each A/V device that natively supports discrete volume control to decrease the volume based on the first rate and a level corresponding to the initial volume of the A/V device, and calculates a second discrete level that is supplied to each A/V device that natively supports discrete volume control to increase the volume based on the second rate and the level corresponding to the initial volume of the A/V device.
9. The method of claim 1, where at least one of the one or more A/V devices natively supports relative volume control, and the software executing on the electronic device or another electronic device calculates a number of incremental volume decreases that are supplied to each A/V device that natively supports relative volume control to decrease the volume based on the first rate and a mapping of rates to numbers of incremental volume changes, and calculates a number of incremental decreases that are supplied to each A/V device that natively supports relative volume control to increase the volume based on the second rate and the mapping.
10. The method of claim 1, wherein the electronic device is a remote control unit or a mobile device executing a control application (app) of a home automation system.
11. The method of claim 1, wherein the display screen is a touch sensitive display screen, and the user input is to touch and drag the element on the touch sensitive display screen.
12. A method for controlling volume of one or more audio/video (A/V) devices, comprising:
receiving user input on a volume control that includes:
a range having a minimum extent and a maximum extent, and
an element that is slidable within the range from an initial position to temporary positions located towards the minimum extent or the maximum extent of the range when presently subject to user input, the element to automatically return to the initial position when the user input is removed; and
in response to the element being slid to a first temporary position located towards the minimum extent from the initial position, decreasing the volume of each of the one or more A/V devices from a respective initial volume at a first rate, the first rate being proportional to a distance between the center of the range and the first temporary position; and
in response to the element being slid to a second temporary position located towards the maximum extent from the center of the range, increasing the volume of each of the one or more A/V devices from the respective initial volume at a second rate, the second rate being proportional to a distance between the center of the range and the second temporary position.
13. The method of claim 12, wherein the volume control is part of in a graphical user interface presented on a display screen of an electronic device.
14. The method of claim 12, wherein the volume control is a physical control provided as part of an electronic device.
15. An electronic device usable to control volume of one or more audio/video (A/V) devices, comprising:
a touch sensitive display screen;
a processor; and
a memory storing software that is executable on the processor, the software including a control application (app) that when executed is operable to:
display, in a graphical user interface shown on the touch sensitive display screen, a volume control that includes:
a range having a minimum extent, a maximum extent and a center, and
an element that is slidable within the range, the element located at the center of the range by default when not presently touched by a user on the touch sensitive display, and slidable to temporary positions located towards the minimum extent or the maximum extent of the range when dragged by the user, the element configured to automatically return to the center of the range when released by the user, and
in response to the element being touched and dragged to a first temporary position located towards the maximum extent from the center of the range, cause one or more control commands to be issued to decrease the volume of each of the one or more A/V devices from a respective initial volume at a first rate, the first rate being proportional to a distance between the center of the range and the first temporary position, and
in response to the element being touched and dragged to a second temporary position located towards the maximum extent from the center of the range cause one or more control commands to be issued to increase the volume of each of the one or more A/V devices from the respective initial volume at a second rate, the second rate being proportional to a distance between the center of the range and the second temporary position.
16. The electronic device of claim 15, wherein the volume control further includes:
an indicator that is shown at least when the element is dragged to the first temporary position or the second temporary position, the indicator indicating the first rate at which the volume of the one or more A/V devices is decreasing or the second rate at which the volume of the of the one or more A/V devices is increasing.
17. The electronic device of claim 15, wherein the one or more A/V devices are a plurality of A/V devices, and the one or more control commands to decrease the volume operate to decrease the volume of each of the plurality of A/V devices at the same first rate, and the one or more control commands to increase the volume operate to increase the volume of each of the plurality of A/V devices at the same second rate.
18. The electronic device of claim 17, wherein the plurality of A/V devices are organized into a plurality of rooms, the graphical user interface includes a plurality of room-specific volume controls that control volume of A/V devices of corresponding rooms, and the volume control is a master volume control that controls volume of A/V devices of all the plurality of rooms.
19. The electronic device of claim 15, where at least one of the one or more A/V devices natively supports discrete volume adjustment, and the one or more control commands issued to each such A/V device to decrease the volume include a first discrete level that is based on a level corresponding to the initial volume of the A/V device and the first rate, and the one or more control commands issued to each such A/V device to increase the volume include a second discrete level that is based on the level corresponding to the initial volume of the A/V device and the second rate.
20. The electronic device of claim 15, where at least one of the one or more A/V devices natively supports relative volume adjustment, and the one or more control commands issued to each such A/V device to decrease the volume include a number of incremental decrease to that is based on the first rate and a mapping of rates to numbers of incremental volume changes, and the one or more control commands issued to each such A/V device to increase the volume include a number of incremental increases that is based on the second rate and the mapping.
21. A non-transitory electronic device readable medium having instructions stored thereon, the instruction when executed by one or more electronic devices operable to:
receiving user input on a control that includes an element that is movable within a range from an initial position to a first temporary position located towards a minimum extent from the initial position or a second temporary position located towards a maximum extent from the initial position when presently subject to user input, the element to automatically return to the initial position when the user input is removed; and
in response to the element being moved to the first temporary position located towards the minimum extent from the initial position, decreasing the volume of each of the one or more A/V devices from a respective initial volume at a first rate, the first rate being proportional to an amount of movement between the initial position and the first temporary position; and
in response to the element being moved to a second temporary position located towards the maximum extent from the center of the range, increasing the volume of each of the one or more A/V devices from the respective initial volume at a second rate, the second rate being proportional to a distance between the initial position and the second temporary position.
22. The non-transitory electronic device readable medium of claim 21, wherein the element is a slider that is slidable within a linear range from the initial position towards the minimum extent or the maximum extent.
23. The non-transitory electronic device readable medium of claim 21, wherein the element is a knob that is rotatable within a rotational range from the initial position towards the minimum extent or the maximum extent.
24. The non-transitory electronic device readable medium of claim 21, wherein at least one of the one or more A/V devices natively supports discrete volume control, and the instructions when executed are further operable to calculate a first discrete level that is supplied to each A/V device that natively supports discrete volume control to decrease the volume based on the first rate and a level corresponding to the initial volume of the A/V device, or calculates a second discrete level that is supplied to each A/V device that natively supports discrete volume control to increase the volume based on the second rate and the level corresponding to the initial volume of the A/V device.
25. The non-transitory electronic device readable medium of claim 21, wherein at least one of the one or more A/V devices natively supports relative volume control, and the instructions when executed are further operable to calculate a number of incremental volume decreases that are supplied to each A/V device that natively supports relative volume control to decrease the volume based on the first rate and a mapping of rates to numbers of incremental volume changes, or to calculate a number of incremental decreases that are supplied to each A/V device that natively supports relative volume control to increase the volume based on the second rate and the mapping.
US15/347,340 2015-11-10 2016-11-09 Volume control for audio/video devices Active 2037-01-15 US10863267B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US15/347,340 US10863267B2 (en) 2015-11-10 2016-11-09 Volume control for audio/video devices

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201562253472P 2015-11-10 2015-11-10
US15/347,340 US10863267B2 (en) 2015-11-10 2016-11-09 Volume control for audio/video devices

Publications (2)

Publication Number Publication Date
US20170134872A1 true US20170134872A1 (en) 2017-05-11
US10863267B2 US10863267B2 (en) 2020-12-08

Family

ID=58664162

Family Applications (1)

Application Number Title Priority Date Filing Date
US15/347,340 Active 2037-01-15 US10863267B2 (en) 2015-11-10 2016-11-09 Volume control for audio/video devices

Country Status (1)

Country Link
US (1) US10863267B2 (en)

Cited By (85)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109495649A (en) * 2018-12-14 2019-03-19 深圳市沃特沃德股份有限公司 Volume adjusting method, system and storage medium
US20190179611A1 (en) * 2017-12-11 2019-06-13 Sonos, Inc. Systems and Methods of Receiving Voice Input
US10459617B2 (en) * 2016-02-11 2019-10-29 Lenze Automation Gmbh Method for adjusting a range of numerical values at an input device
US10606555B1 (en) 2017-09-29 2020-03-31 Sonos, Inc. Media playback system with concurrent voice assistance
US10614807B2 (en) 2016-10-19 2020-04-07 Sonos, Inc. Arbitration-based voice recognition
US10621981B2 (en) 2017-09-28 2020-04-14 Sonos, Inc. Tone interference cancellation
US10692518B2 (en) 2018-09-29 2020-06-23 Sonos, Inc. Linear filtering for noise-suppressed speech detection via multiple network microphone devices
US10714115B2 (en) 2016-06-09 2020-07-14 Sonos, Inc. Dynamic player selection for audio signal processing
US10743101B2 (en) 2016-02-22 2020-08-11 Sonos, Inc. Content mixing
US10811015B2 (en) 2018-09-25 2020-10-20 Sonos, Inc. Voice detection optimization based on selected voice assistant service
US10847143B2 (en) 2016-02-22 2020-11-24 Sonos, Inc. Voice control of a media playback system
US10847164B2 (en) 2016-08-05 2020-11-24 Sonos, Inc. Playback device supporting concurrent voice assistants
US10847178B2 (en) 2018-05-18 2020-11-24 Sonos, Inc. Linear filtering for noise-suppressed speech detection
US10873819B2 (en) 2016-09-30 2020-12-22 Sonos, Inc. Orientation-based playback device microphone selection
US10871943B1 (en) 2019-07-31 2020-12-22 Sonos, Inc. Noise classification for event detection
US10880644B1 (en) 2017-09-28 2020-12-29 Sonos, Inc. Three-dimensional beam forming with a microphone array
US10880650B2 (en) 2017-12-10 2020-12-29 Sonos, Inc. Network microphone devices with automatic do not disturb actuation capabilities
US10878811B2 (en) 2018-09-14 2020-12-29 Sonos, Inc. Networked devices, systems, and methods for intelligently deactivating wake-word engines
US10891932B2 (en) 2017-09-28 2021-01-12 Sonos, Inc. Multi-channel acoustic echo cancellation
US10959029B2 (en) 2018-05-25 2021-03-23 Sonos, Inc. Determining and adapting to changes in microphone performance of playback devices
US10970035B2 (en) 2016-02-22 2021-04-06 Sonos, Inc. Audio response playback
US10992795B2 (en) 2017-05-16 2021-04-27 Apple Inc. Methods and interfaces for home media control
US10996917B2 (en) 2019-05-31 2021-05-04 Apple Inc. User interfaces for audio media control
US11017789B2 (en) 2017-09-27 2021-05-25 Sonos, Inc. Robust Short-Time Fourier Transform acoustic echo cancellation during audio playback
US11024331B2 (en) 2018-09-21 2021-06-01 Sonos, Inc. Voice detection optimization using sound metadata
US11042355B2 (en) 2016-02-22 2021-06-22 Sonos, Inc. Handling of loss of pairing between networked devices
US11076035B2 (en) 2018-08-28 2021-07-27 Sonos, Inc. Do not disturb feature for audio notifications
US11080005B2 (en) 2017-09-08 2021-08-03 Sonos, Inc. Dynamic computation of system response volume
US11080004B2 (en) 2019-05-31 2021-08-03 Apple Inc. Methods and user interfaces for sharing audio
US11079913B1 (en) 2020-05-11 2021-08-03 Apple Inc. User interface for status indicators
US11079894B2 (en) 2015-03-08 2021-08-03 Apple Inc. Device configuration user interface
US11100923B2 (en) 2018-09-28 2021-08-24 Sonos, Inc. Systems and methods for selective wake word detection using neural network models
US11132989B2 (en) 2018-12-13 2021-09-28 Sonos, Inc. Networked microphone devices, systems, and methods of localized arbitration
US11138969B2 (en) 2019-07-31 2021-10-05 Sonos, Inc. Locally distributed keyword detection
US11138975B2 (en) 2019-07-31 2021-10-05 Sonos, Inc. Locally distributed keyword detection
US11159880B2 (en) 2018-12-20 2021-10-26 Sonos, Inc. Optimization of network microphone devices using noise classification
US11175880B2 (en) 2018-05-10 2021-11-16 Sonos, Inc. Systems and methods for voice-assisted media content selection
US11184969B2 (en) 2016-07-15 2021-11-23 Sonos, Inc. Contextualization of voice inputs
US11183181B2 (en) 2017-03-27 2021-11-23 Sonos, Inc. Systems and methods of multiple voice services
US11183183B2 (en) 2018-12-07 2021-11-23 Sonos, Inc. Systems and methods of operating media playback systems having multiple voice assistant services
US11189286B2 (en) 2019-10-22 2021-11-30 Sonos, Inc. VAS toggle based on device orientation
US11197096B2 (en) 2018-06-28 2021-12-07 Sonos, Inc. Systems and methods for associating playback devices with voice assistant services
US11200894B2 (en) 2019-06-12 2021-12-14 Sonos, Inc. Network microphone device with command keyword eventing
US11200889B2 (en) 2018-11-15 2021-12-14 Sonos, Inc. Dilated convolutions and gating for efficient keyword spotting
US11200900B2 (en) 2019-12-20 2021-12-14 Sonos, Inc. Offline voice control
US11283916B2 (en) 2017-05-16 2022-03-22 Apple Inc. Methods and interfaces for configuring a device in accordance with an audio tone signal
US11301130B2 (en) 2019-05-06 2022-04-12 Apple Inc. Restricted operation of an electronic device
US11308962B2 (en) 2020-05-20 2022-04-19 Sonos, Inc. Input detection windowing
US11308958B2 (en) 2020-02-07 2022-04-19 Sonos, Inc. Localized wakeword verification
US11315556B2 (en) 2019-02-08 2022-04-26 Sonos, Inc. Devices, systems, and methods for distributed voice processing by transmitting sound data associated with a wake word to an appropriate device for identification
US11343614B2 (en) 2018-01-31 2022-05-24 Sonos, Inc. Device designation of playback and network microphone device arrangements
US11361756B2 (en) 2019-06-12 2022-06-14 Sonos, Inc. Conditional wake word eventing based on environment
US20220206741A1 (en) * 2019-09-19 2022-06-30 Huawei Technologies Co., Ltd. Volume adjustment method and electronic device
US11380322B2 (en) 2017-08-07 2022-07-05 Sonos, Inc. Wake-word detection suppression
US11392291B2 (en) 2020-09-25 2022-07-19 Apple Inc. Methods and interfaces for media control with dynamic feedback
US11405430B2 (en) 2016-02-22 2022-08-02 Sonos, Inc. Networked microphone device control
US11431836B2 (en) 2017-05-02 2022-08-30 Apple Inc. Methods and interfaces for initiating media playback
US11432030B2 (en) 2018-09-14 2022-08-30 Sonos, Inc. Networked devices, systems, and methods for associating playback devices based on sound codes
USD963685S1 (en) 2018-12-06 2022-09-13 Sonos, Inc. Display screen or portion thereof with graphical user interface for media playback control
US11482224B2 (en) 2020-05-20 2022-10-25 Sonos, Inc. Command keywords with input detection windowing
US11482978B2 (en) 2018-08-28 2022-10-25 Sonos, Inc. Audio notifications
US20220342536A1 (en) * 2021-04-26 2022-10-27 Bushel, Inc. User interface for adjusting component proportions
US11501773B2 (en) 2019-06-12 2022-11-15 Sonos, Inc. Network microphone device with command keyword conditioning
US11539831B2 (en) 2013-03-15 2022-12-27 Apple Inc. Providing remote interactions with host device using a wireless device
US11551700B2 (en) 2021-01-25 2023-01-10 Sonos, Inc. Systems and methods for power-efficient keyword detection
US11556306B2 (en) 2016-02-22 2023-01-17 Sonos, Inc. Voice controlled media playback system
US11556307B2 (en) 2020-01-31 2023-01-17 Sonos, Inc. Local voice data processing
US11562740B2 (en) 2020-01-07 2023-01-24 Sonos, Inc. Voice verification for media playback
US11604571B2 (en) 2014-07-21 2023-03-14 Apple Inc. Remote user interface
US11609681B2 (en) 2014-09-02 2023-03-21 Apple Inc. Reduced size configuration interface
US11620103B2 (en) 2019-05-31 2023-04-04 Apple Inc. User interfaces for audio media control
US11641559B2 (en) 2016-09-27 2023-05-02 Sonos, Inc. Audio playback settings for voice interaction
US11646023B2 (en) 2019-02-08 2023-05-09 Sonos, Inc. Devices, systems, and methods for distributed voice processing
US11664023B2 (en) 2016-07-15 2023-05-30 Sonos, Inc. Voice detection by multiple devices
US11676590B2 (en) 2017-12-11 2023-06-13 Sonos, Inc. Home graph
US11683408B2 (en) 2017-05-16 2023-06-20 Apple Inc. Methods and interfaces for home media control
US11698771B2 (en) 2020-08-25 2023-07-11 Sonos, Inc. Vocal guidance engines for playback devices
US11700326B2 (en) 2014-09-02 2023-07-11 Apple Inc. Phone user interface
US11727919B2 (en) 2020-05-20 2023-08-15 Sonos, Inc. Memory allocation for keyword spotting engines
US11798553B2 (en) 2019-05-03 2023-10-24 Sonos, Inc. Voice assistant persistence across multiple network microphone devices
US11847378B2 (en) 2021-06-06 2023-12-19 Apple Inc. User interfaces for audio routing
US11899519B2 (en) 2018-10-23 2024-02-13 Sonos, Inc. Multiple stage network microphone device with reduced power consumption and processing load
US11984123B2 (en) 2020-11-12 2024-05-14 Sonos, Inc. Network device interaction by range
US12197699B2 (en) 2017-05-12 2025-01-14 Apple Inc. User interfaces for playing and managing audio items
US12283269B2 (en) 2020-10-16 2025-04-22 Sonos, Inc. Intent inference in audiovisual communication sessions

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11234142B2 (en) * 2020-01-16 2022-01-25 Allied Telesis Holdings Kabushiki Kaisha System and method for single-channel architecture for immediate access point redundancy
JP7083380B2 (en) * 2020-09-28 2022-06-10 グリー株式会社 Computer programs, methods and server equipment
US20240411508A1 (en) * 2023-06-08 2024-12-12 Motorola Solutions, Inc. Volume control for an electronic device
US20240414476A1 (en) * 2023-06-08 2024-12-12 Motorola Solutions, Inc. Volume control for an electronic device

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080285781A1 (en) * 2005-11-18 2008-11-20 Koninklijke Philips Electronics, N.V. Signal Processing System, for Example Sound Signal Processing System or a Hearing Aid Device
US20140193140A1 (en) * 2012-08-13 2014-07-10 Iconic Sports Technology, Inc. System and method for slow motion display, analysis and/or editing of audiovisual content on a mobile device
US20140253520A1 (en) * 2013-03-11 2014-09-11 Barnesandnoble.Com Llc Stylus-based slider functionality for ui control of computing device
US20150227303A1 (en) * 2012-08-20 2015-08-13 Sony Corporation Electronic apparatus, apparatus operation method, and program

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5182552A (en) 1989-08-24 1993-01-26 Bose Corporation Multiple zone audio system
US7831054B2 (en) 2005-06-28 2010-11-09 Microsoft Corporation Volume control
JP4645347B2 (en) 2005-07-29 2011-03-09 ヤマハ株式会社 Mixing apparatus and program
US9153125B2 (en) 2005-12-20 2015-10-06 Savant Systems, Llc Programmable multimedia controller with programmable services
US20080184139A1 (en) * 2007-01-29 2008-07-31 Brian Robert Stewart System and method for generating graphical user interfaces and graphical user interface models
US8127246B2 (en) 2007-10-01 2012-02-28 Apple Inc. Varying user interface element based on movement
US8611559B2 (en) 2010-08-31 2013-12-17 Apple Inc. Dynamic adjustment of master and individual volume controls
JP5609445B2 (en) * 2010-09-03 2014-10-22 ソニー株式会社 Control terminal device and control method
US20120223959A1 (en) 2011-03-01 2012-09-06 Apple Inc. System and method for a touchscreen slider with toggle control
WO2012140469A1 (en) 2011-04-11 2012-10-18 Nokia Corporation Volume control apparatus
US8972858B2 (en) 2012-04-19 2015-03-03 Savant Systems, Llc Configuration interface for a programmable multimedia controller
US20140075311A1 (en) 2012-09-11 2014-03-13 Jesse William Boettcher Methods and apparatus for controlling audio volume on an electronic device
US10042336B2 (en) 2014-09-09 2018-08-07 Savant Systems, Llc User-defined scenes for home automation

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080285781A1 (en) * 2005-11-18 2008-11-20 Koninklijke Philips Electronics, N.V. Signal Processing System, for Example Sound Signal Processing System or a Hearing Aid Device
US20140193140A1 (en) * 2012-08-13 2014-07-10 Iconic Sports Technology, Inc. System and method for slow motion display, analysis and/or editing of audiovisual content on a mobile device
US20150227303A1 (en) * 2012-08-20 2015-08-13 Sony Corporation Electronic apparatus, apparatus operation method, and program
US20140253520A1 (en) * 2013-03-11 2014-09-11 Barnesandnoble.Com Llc Stylus-based slider functionality for ui control of computing device

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
Phree, "Make the world your paper", Kickstarter, July 19, 2015 *

Cited By (174)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11539831B2 (en) 2013-03-15 2022-12-27 Apple Inc. Providing remote interactions with host device using a wireless device
US11604571B2 (en) 2014-07-21 2023-03-14 Apple Inc. Remote user interface
US12093515B2 (en) 2014-07-21 2024-09-17 Apple Inc. Remote user interface
US11700326B2 (en) 2014-09-02 2023-07-11 Apple Inc. Phone user interface
US12164747B2 (en) 2014-09-02 2024-12-10 Apple Inc. Reduced size configuration interface
US11609681B2 (en) 2014-09-02 2023-03-21 Apple Inc. Reduced size configuration interface
US11079894B2 (en) 2015-03-08 2021-08-03 Apple Inc. Device configuration user interface
US10459617B2 (en) * 2016-02-11 2019-10-29 Lenze Automation Gmbh Method for adjusting a range of numerical values at an input device
US10847143B2 (en) 2016-02-22 2020-11-24 Sonos, Inc. Voice control of a media playback system
US11212612B2 (en) 2016-02-22 2021-12-28 Sonos, Inc. Voice control of a media playback system
US12047752B2 (en) 2016-02-22 2024-07-23 Sonos, Inc. Content mixing
US11514898B2 (en) 2016-02-22 2022-11-29 Sonos, Inc. Voice control of a media playback system
US11137979B2 (en) 2016-02-22 2021-10-05 Sonos, Inc. Metadata exchange involving a networked playback system and a networked microphone system
US11983463B2 (en) 2016-02-22 2024-05-14 Sonos, Inc. Metadata exchange involving a networked playback system and a networked microphone system
US11184704B2 (en) 2016-02-22 2021-11-23 Sonos, Inc. Music service selection
US11556306B2 (en) 2016-02-22 2023-01-17 Sonos, Inc. Voice controlled media playback system
US11863593B2 (en) 2016-02-22 2024-01-02 Sonos, Inc. Networked microphone device control
US11832068B2 (en) 2016-02-22 2023-11-28 Sonos, Inc. Music service selection
US11750969B2 (en) 2016-02-22 2023-09-05 Sonos, Inc. Default playback device designation
US11736860B2 (en) 2016-02-22 2023-08-22 Sonos, Inc. Voice control of a media playback system
US11726742B2 (en) 2016-02-22 2023-08-15 Sonos, Inc. Handling of loss of pairing between networked devices
US10971139B2 (en) 2016-02-22 2021-04-06 Sonos, Inc. Voice control of a media playback system
US10970035B2 (en) 2016-02-22 2021-04-06 Sonos, Inc. Audio response playback
US11513763B2 (en) 2016-02-22 2022-11-29 Sonos, Inc. Audio response playback
US10743101B2 (en) 2016-02-22 2020-08-11 Sonos, Inc. Content mixing
US11006214B2 (en) 2016-02-22 2021-05-11 Sonos, Inc. Default playback device designation
US11042355B2 (en) 2016-02-22 2021-06-22 Sonos, Inc. Handling of loss of pairing between networked devices
US10764679B2 (en) 2016-02-22 2020-09-01 Sonos, Inc. Voice control of a media playback system
US11405430B2 (en) 2016-02-22 2022-08-02 Sonos, Inc. Networked microphone device control
US10714115B2 (en) 2016-06-09 2020-07-14 Sonos, Inc. Dynamic player selection for audio signal processing
US11545169B2 (en) 2016-06-09 2023-01-03 Sonos, Inc. Dynamic player selection for audio signal processing
US11133018B2 (en) 2016-06-09 2021-09-28 Sonos, Inc. Dynamic player selection for audio signal processing
US11664023B2 (en) 2016-07-15 2023-05-30 Sonos, Inc. Voice detection by multiple devices
US11979960B2 (en) 2016-07-15 2024-05-07 Sonos, Inc. Contextualization of voice inputs
US11184969B2 (en) 2016-07-15 2021-11-23 Sonos, Inc. Contextualization of voice inputs
US10847164B2 (en) 2016-08-05 2020-11-24 Sonos, Inc. Playback device supporting concurrent voice assistants
US11531520B2 (en) 2016-08-05 2022-12-20 Sonos, Inc. Playback device supporting concurrent voice assistants
US11641559B2 (en) 2016-09-27 2023-05-02 Sonos, Inc. Audio playback settings for voice interaction
US11516610B2 (en) 2016-09-30 2022-11-29 Sonos, Inc. Orientation-based playback device microphone selection
US10873819B2 (en) 2016-09-30 2020-12-22 Sonos, Inc. Orientation-based playback device microphone selection
US10614807B2 (en) 2016-10-19 2020-04-07 Sonos, Inc. Arbitration-based voice recognition
US11308961B2 (en) 2016-10-19 2022-04-19 Sonos, Inc. Arbitration-based voice recognition
US11727933B2 (en) 2016-10-19 2023-08-15 Sonos, Inc. Arbitration-based voice recognition
US12217748B2 (en) 2017-03-27 2025-02-04 Sonos, Inc. Systems and methods of multiple voice services
US11183181B2 (en) 2017-03-27 2021-11-23 Sonos, Inc. Systems and methods of multiple voice services
US11431836B2 (en) 2017-05-02 2022-08-30 Apple Inc. Methods and interfaces for initiating media playback
US12197699B2 (en) 2017-05-12 2025-01-14 Apple Inc. User interfaces for playing and managing audio items
US11750734B2 (en) 2017-05-16 2023-09-05 Apple Inc. Methods for initiating output of at least a component of a signal representative of media currently being played back by another device
US12107985B2 (en) 2017-05-16 2024-10-01 Apple Inc. Methods and interfaces for home media control
US12244755B2 (en) 2017-05-16 2025-03-04 Apple Inc. Methods and interfaces for configuring a device in accordance with an audio tone signal
US10992795B2 (en) 2017-05-16 2021-04-27 Apple Inc. Methods and interfaces for home media control
US11412081B2 (en) 2017-05-16 2022-08-09 Apple Inc. Methods and interfaces for configuring an electronic device to initiate playback of media
US11095766B2 (en) 2017-05-16 2021-08-17 Apple Inc. Methods and interfaces for adjusting an audible signal based on a spatial position of a voice command source
US11283916B2 (en) 2017-05-16 2022-03-22 Apple Inc. Methods and interfaces for configuring a device in accordance with an audio tone signal
US11683408B2 (en) 2017-05-16 2023-06-20 Apple Inc. Methods and interfaces for home media control
US11201961B2 (en) 2017-05-16 2021-12-14 Apple Inc. Methods and interfaces for adjusting the volume of media
US11380322B2 (en) 2017-08-07 2022-07-05 Sonos, Inc. Wake-word detection suppression
US11900937B2 (en) 2017-08-07 2024-02-13 Sonos, Inc. Wake-word detection suppression
US11500611B2 (en) 2017-09-08 2022-11-15 Sonos, Inc. Dynamic computation of system response volume
US11080005B2 (en) 2017-09-08 2021-08-03 Sonos, Inc. Dynamic computation of system response volume
US11017789B2 (en) 2017-09-27 2021-05-25 Sonos, Inc. Robust Short-Time Fourier Transform acoustic echo cancellation during audio playback
US11646045B2 (en) 2017-09-27 2023-05-09 Sonos, Inc. Robust short-time fourier transform acoustic echo cancellation during audio playback
US11302326B2 (en) 2017-09-28 2022-04-12 Sonos, Inc. Tone interference cancellation
US12047753B1 (en) 2017-09-28 2024-07-23 Sonos, Inc. Three-dimensional beam forming with a microphone array
US10880644B1 (en) 2017-09-28 2020-12-29 Sonos, Inc. Three-dimensional beam forming with a microphone array
US10621981B2 (en) 2017-09-28 2020-04-14 Sonos, Inc. Tone interference cancellation
US11538451B2 (en) 2017-09-28 2022-12-27 Sonos, Inc. Multi-channel acoustic echo cancellation
US11769505B2 (en) 2017-09-28 2023-09-26 Sonos, Inc. Echo of tone interferance cancellation using two acoustic echo cancellers
US12236932B2 (en) 2017-09-28 2025-02-25 Sonos, Inc. Multi-channel acoustic echo cancellation
US10891932B2 (en) 2017-09-28 2021-01-12 Sonos, Inc. Multi-channel acoustic echo cancellation
US11893308B2 (en) 2017-09-29 2024-02-06 Sonos, Inc. Media playback system with concurrent voice assistance
US11288039B2 (en) 2017-09-29 2022-03-29 Sonos, Inc. Media playback system with concurrent voice assistance
US10606555B1 (en) 2017-09-29 2020-03-31 Sonos, Inc. Media playback system with concurrent voice assistance
US11175888B2 (en) 2017-09-29 2021-11-16 Sonos, Inc. Media playback system with concurrent voice assistance
US11451908B2 (en) 2017-12-10 2022-09-20 Sonos, Inc. Network microphone devices with automatic do not disturb actuation capabilities
US10880650B2 (en) 2017-12-10 2020-12-29 Sonos, Inc. Network microphone devices with automatic do not disturb actuation capabilities
US11676590B2 (en) 2017-12-11 2023-06-13 Sonos, Inc. Home graph
US20190179611A1 (en) * 2017-12-11 2019-06-13 Sonos, Inc. Systems and Methods of Receiving Voice Input
US11343614B2 (en) 2018-01-31 2022-05-24 Sonos, Inc. Device designation of playback and network microphone device arrangements
US11689858B2 (en) 2018-01-31 2023-06-27 Sonos, Inc. Device designation of playback and network microphone device arrangements
US11797263B2 (en) 2018-05-10 2023-10-24 Sonos, Inc. Systems and methods for voice-assisted media content selection
US11175880B2 (en) 2018-05-10 2021-11-16 Sonos, Inc. Systems and methods for voice-assisted media content selection
US10847178B2 (en) 2018-05-18 2020-11-24 Sonos, Inc. Linear filtering for noise-suppressed speech detection
US11715489B2 (en) 2018-05-18 2023-08-01 Sonos, Inc. Linear filtering for noise-suppressed speech detection
US10959029B2 (en) 2018-05-25 2021-03-23 Sonos, Inc. Determining and adapting to changes in microphone performance of playback devices
US11792590B2 (en) 2018-05-25 2023-10-17 Sonos, Inc. Determining and adapting to changes in microphone performance of playback devices
US11696074B2 (en) 2018-06-28 2023-07-04 Sonos, Inc. Systems and methods for associating playback devices with voice assistant services
US11197096B2 (en) 2018-06-28 2021-12-07 Sonos, Inc. Systems and methods for associating playback devices with voice assistant services
US11482978B2 (en) 2018-08-28 2022-10-25 Sonos, Inc. Audio notifications
US11076035B2 (en) 2018-08-28 2021-07-27 Sonos, Inc. Do not disturb feature for audio notifications
US11563842B2 (en) 2018-08-28 2023-01-24 Sonos, Inc. Do not disturb feature for audio notifications
US11551690B2 (en) 2018-09-14 2023-01-10 Sonos, Inc. Networked devices, systems, and methods for intelligently deactivating wake-word engines
US11778259B2 (en) 2018-09-14 2023-10-03 Sonos, Inc. Networked devices, systems and methods for associating playback devices based on sound codes
US11432030B2 (en) 2018-09-14 2022-08-30 Sonos, Inc. Networked devices, systems, and methods for associating playback devices based on sound codes
US10878811B2 (en) 2018-09-14 2020-12-29 Sonos, Inc. Networked devices, systems, and methods for intelligently deactivating wake-word engines
US11790937B2 (en) 2018-09-21 2023-10-17 Sonos, Inc. Voice detection optimization using sound metadata
US12230291B2 (en) 2018-09-21 2025-02-18 Sonos, Inc. Voice detection optimization using sound metadata
US11024331B2 (en) 2018-09-21 2021-06-01 Sonos, Inc. Voice detection optimization using sound metadata
US10811015B2 (en) 2018-09-25 2020-10-20 Sonos, Inc. Voice detection optimization based on selected voice assistant service
US12165651B2 (en) 2018-09-25 2024-12-10 Sonos, Inc. Voice detection optimization based on selected voice assistant service
US11031014B2 (en) 2018-09-25 2021-06-08 Sonos, Inc. Voice detection optimization based on selected voice assistant service
US11727936B2 (en) 2018-09-25 2023-08-15 Sonos, Inc. Voice detection optimization based on selected voice assistant service
US12165644B2 (en) 2018-09-28 2024-12-10 Sonos, Inc. Systems and methods for selective wake word detection
US11790911B2 (en) 2018-09-28 2023-10-17 Sonos, Inc. Systems and methods for selective wake word detection using neural network models
US11100923B2 (en) 2018-09-28 2021-08-24 Sonos, Inc. Systems and methods for selective wake word detection using neural network models
US10692518B2 (en) 2018-09-29 2020-06-23 Sonos, Inc. Linear filtering for noise-suppressed speech detection via multiple network microphone devices
US12062383B2 (en) 2018-09-29 2024-08-13 Sonos, Inc. Linear filtering for noise-suppressed speech detection via multiple network microphone devices
US11501795B2 (en) 2018-09-29 2022-11-15 Sonos, Inc. Linear filtering for noise-suppressed speech detection via multiple network microphone devices
US11899519B2 (en) 2018-10-23 2024-02-13 Sonos, Inc. Multiple stage network microphone device with reduced power consumption and processing load
US11741948B2 (en) 2018-11-15 2023-08-29 Sonos Vox France Sas Dilated convolutions and gating for efficient keyword spotting
US11200889B2 (en) 2018-11-15 2021-12-14 Sonos, Inc. Dilated convolutions and gating for efficient keyword spotting
USD1008306S1 (en) 2018-12-06 2023-12-19 Sonos, Inc. Display screen or portion thereof with graphical user interface for media playback control
USD975126S1 (en) 2018-12-06 2023-01-10 Sonos, Inc. Display screen or portion thereof with graphical user interface for media playback control
USD963685S1 (en) 2018-12-06 2022-09-13 Sonos, Inc. Display screen or portion thereof with graphical user interface for media playback control
US11557294B2 (en) 2018-12-07 2023-01-17 Sonos, Inc. Systems and methods of operating media playback systems having multiple voice assistant services
US11183183B2 (en) 2018-12-07 2021-11-23 Sonos, Inc. Systems and methods of operating media playback systems having multiple voice assistant services
US11132989B2 (en) 2018-12-13 2021-09-28 Sonos, Inc. Networked microphone devices, systems, and methods of localized arbitration
US11538460B2 (en) 2018-12-13 2022-12-27 Sonos, Inc. Networked microphone devices, systems, and methods of localized arbitration
CN109495649A (en) * 2018-12-14 2019-03-19 深圳市沃特沃德股份有限公司 Volume adjusting method, system and storage medium
US11159880B2 (en) 2018-12-20 2021-10-26 Sonos, Inc. Optimization of network microphone devices using noise classification
US11540047B2 (en) 2018-12-20 2022-12-27 Sonos, Inc. Optimization of network microphone devices using noise classification
US11315556B2 (en) 2019-02-08 2022-04-26 Sonos, Inc. Devices, systems, and methods for distributed voice processing by transmitting sound data associated with a wake word to an appropriate device for identification
US11646023B2 (en) 2019-02-08 2023-05-09 Sonos, Inc. Devices, systems, and methods for distributed voice processing
US11798553B2 (en) 2019-05-03 2023-10-24 Sonos, Inc. Voice assistant persistence across multiple network microphone devices
US11340778B2 (en) 2019-05-06 2022-05-24 Apple Inc. Restricted operation of an electronic device
US11301130B2 (en) 2019-05-06 2022-04-12 Apple Inc. Restricted operation of an electronic device
US12265703B2 (en) 2019-05-06 2025-04-01 Apple Inc. Restricted operation of an electronic device
US11755273B2 (en) 2019-05-31 2023-09-12 Apple Inc. User interfaces for audio media control
US11714597B2 (en) 2019-05-31 2023-08-01 Apple Inc. Methods and user interfaces for sharing audio
US11620103B2 (en) 2019-05-31 2023-04-04 Apple Inc. User interfaces for audio media control
US11080004B2 (en) 2019-05-31 2021-08-03 Apple Inc. Methods and user interfaces for sharing audio
US11157234B2 (en) * 2019-05-31 2021-10-26 Apple Inc. Methods and user interfaces for sharing audio
US11853646B2 (en) 2019-05-31 2023-12-26 Apple Inc. User interfaces for audio media control
US10996917B2 (en) 2019-05-31 2021-05-04 Apple Inc. User interfaces for audio media control
US12223228B2 (en) 2019-05-31 2025-02-11 Apple Inc. User interfaces for audio media control
US11010121B2 (en) 2019-05-31 2021-05-18 Apple Inc. User interfaces for audio media control
US11200894B2 (en) 2019-06-12 2021-12-14 Sonos, Inc. Network microphone device with command keyword eventing
US11361756B2 (en) 2019-06-12 2022-06-14 Sonos, Inc. Conditional wake word eventing based on environment
US11501773B2 (en) 2019-06-12 2022-11-15 Sonos, Inc. Network microphone device with command keyword conditioning
US11854547B2 (en) 2019-06-12 2023-12-26 Sonos, Inc. Network microphone device with command keyword eventing
US11354092B2 (en) 2019-07-31 2022-06-07 Sonos, Inc. Noise classification for event detection
US11710487B2 (en) 2019-07-31 2023-07-25 Sonos, Inc. Locally distributed keyword detection
US11714600B2 (en) 2019-07-31 2023-08-01 Sonos, Inc. Noise classification for event detection
US11138969B2 (en) 2019-07-31 2021-10-05 Sonos, Inc. Locally distributed keyword detection
US10871943B1 (en) 2019-07-31 2020-12-22 Sonos, Inc. Noise classification for event detection
US12211490B2 (en) 2019-07-31 2025-01-28 Sonos, Inc. Locally distributed keyword detection
US11138975B2 (en) 2019-07-31 2021-10-05 Sonos, Inc. Locally distributed keyword detection
US11551669B2 (en) 2019-07-31 2023-01-10 Sonos, Inc. Locally distributed keyword detection
US20220206741A1 (en) * 2019-09-19 2022-06-30 Huawei Technologies Co., Ltd. Volume adjustment method and electronic device
US11862161B2 (en) 2019-10-22 2024-01-02 Sonos, Inc. VAS toggle based on device orientation
US11189286B2 (en) 2019-10-22 2021-11-30 Sonos, Inc. VAS toggle based on device orientation
US11200900B2 (en) 2019-12-20 2021-12-14 Sonos, Inc. Offline voice control
US11869503B2 (en) 2019-12-20 2024-01-09 Sonos, Inc. Offline voice control
US11562740B2 (en) 2020-01-07 2023-01-24 Sonos, Inc. Voice verification for media playback
US11556307B2 (en) 2020-01-31 2023-01-17 Sonos, Inc. Local voice data processing
US11961519B2 (en) 2020-02-07 2024-04-16 Sonos, Inc. Localized wakeword verification
US11308958B2 (en) 2020-02-07 2022-04-19 Sonos, Inc. Localized wakeword verification
US11513667B2 (en) 2020-05-11 2022-11-29 Apple Inc. User interface for audio message
US12265696B2 (en) 2020-05-11 2025-04-01 Apple Inc. User interface for audio message
US11079913B1 (en) 2020-05-11 2021-08-03 Apple Inc. User interface for status indicators
US11482224B2 (en) 2020-05-20 2022-10-25 Sonos, Inc. Command keywords with input detection windowing
US11308962B2 (en) 2020-05-20 2022-04-19 Sonos, Inc. Input detection windowing
US11727919B2 (en) 2020-05-20 2023-08-15 Sonos, Inc. Memory allocation for keyword spotting engines
US11694689B2 (en) 2020-05-20 2023-07-04 Sonos, Inc. Input detection windowing
US11698771B2 (en) 2020-08-25 2023-07-11 Sonos, Inc. Vocal guidance engines for playback devices
US12112037B2 (en) 2020-09-25 2024-10-08 Apple Inc. Methods and interfaces for media control with dynamic feedback
US11782598B2 (en) 2020-09-25 2023-10-10 Apple Inc. Methods and interfaces for media control with dynamic feedback
US11392291B2 (en) 2020-09-25 2022-07-19 Apple Inc. Methods and interfaces for media control with dynamic feedback
US12283269B2 (en) 2020-10-16 2025-04-22 Sonos, Inc. Intent inference in audiovisual communication sessions
US11984123B2 (en) 2020-11-12 2024-05-14 Sonos, Inc. Network device interaction by range
US11551700B2 (en) 2021-01-25 2023-01-10 Sonos, Inc. Systems and methods for power-efficient keyword detection
US12001664B2 (en) * 2021-04-26 2024-06-04 Bushel, Inc. User interface for adjusting component proportions
US20220342536A1 (en) * 2021-04-26 2022-10-27 Bushel, Inc. User interface for adjusting component proportions
US11847378B2 (en) 2021-06-06 2023-12-19 Apple Inc. User interfaces for audio routing

Also Published As

Publication number Publication date
US10863267B2 (en) 2020-12-08

Similar Documents

Publication Publication Date Title
US10863267B2 (en) Volume control for audio/video devices
CN108931924B (en) Control method and device of intelligent household system, processor and storage medium
US9876652B2 (en) Automatic configuration of control device user interface in a home automation system
CN107710689B (en) Cloud synchronization architecture for home automation systems
CN107078930B (en) Method and apparatus for generating and using user-defined scenarios for home automation
US10802668B2 (en) Small screen virtual room-based user interface
US7991866B2 (en) Systems and methods for updating a site
US20130035077A1 (en) Electronic device, storage medium and method for remotely controlling household electric appliances
CA2839342A1 (en) User interface screens for zoned hvac systems, a controller employing the screens and a method of operating a zoned hvac system
CN105207864A (en) Household appliance control method and device
US9882989B2 (en) Systems and methods for providing remote assistance for controlling a site
EP4319119A2 (en) Controlling display device settings from a mobile device touch interface
CN109891370B (en) Method and system for assisting object control and non-transitory computer readable recording medium
US8761712B1 (en) Location based remote controller for controlling different electronic devices located in different locations
AU2018329837B2 (en) Small screen virtual room-based user interface
US11978337B2 (en) Thermostat and system and method for use of same
US20190190740A1 (en) Home automation system including cloud server based maintenance operation communication and related methods
US10802513B1 (en) Comfort control system with hierarchical switching mechanisms
KR20190077867A (en) Electronic device and method for displaying slider track and slider
US10892907B2 (en) Home automation system including user interface operation according to user cognitive level and related methods
US10561004B2 (en) Home automation system including light dimmer operation based upon a sequence of partial dimming commands and related methods
US20240160298A1 (en) Point and gesture control of remote devices
CN110442058B (en) Equipment control method, storage medium and electronic equipment
WO2025026103A1 (en) Control method and device
TW201327363A (en) Control system operation interface applied in a specific space

Legal Events

Date Code Title Description
AS Assignment

Owner name: SAVANT SYSTEMS, LLC, MASSACHUSETTS

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:SILVA, MICHAEL C.;KATSIRIS, GEORGE T.;HAMM, ANDREW R.;AND OTHERS;SIGNING DATES FROM 20161030 TO 20161110;REEL/FRAME:040280/0679

STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: FINAL REJECTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

FEPP Fee payment procedure

Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

AS Assignment

Owner name: SAVANT SYSTEMS, INC., MASSACHUSETTS

Free format text: MERGER AND CHANGE OF NAME;ASSIGNORS:SAVANT SYSTEMS, LLC;SAVANT SYSTEMS, INC.;REEL/FRAME:052909/0373

Effective date: 20200524

AS Assignment

Owner name: PNC BANK, NATIONAL ASSOCIATION, PENNSYLVANIA

Free format text: SECURITY INTEREST;ASSIGNORS:SAVANT SYSTEMS, INC.;CONSUMER LIGHTING (U.S.), LLC;REEL/FRAME:053095/0001

Effective date: 20200630

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS

STCF Information on status: patent grant

Free format text: PATENTED CASE

CC Certificate of correction
AS Assignment

Owner name: RACEPOINT ENERGY, LLC, OHIO

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:PNC BANK, NATIONAL ASSOCIATION;REEL/FRAME:059910/0312

Effective date: 20220331

Owner name: SAVANT TECHNOLOGIES LLC, OHIO

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:PNC BANK, NATIONAL ASSOCIATION;REEL/FRAME:059910/0312

Effective date: 20220331

Owner name: SAVANT SYSTEMS, INC., MASSACHUSETTS

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:PNC BANK, NATIONAL ASSOCIATION;REEL/FRAME:059910/0312

Effective date: 20220331

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 4