SB3384 - 104th General Assembly
| ||||||||||||||||||||||
| ||||||||||||||||||||||
| ||||||||||||||||||||||
| 1 | AN ACT concerning business. | |||||||||||||||||||||
| 2 | Be it enacted by the People of the State of Illinois, | |||||||||||||||||||||
| 3 | represented in the General Assembly: | |||||||||||||||||||||
| 4 | Section 1. Short title. This Act may be cited as the | |||||||||||||||||||||
| 5 | Artificial Intelligence Companion Model Safety Act. | |||||||||||||||||||||
| 6 | Section 5. Definitions. As used in this Act: | |||||||||||||||||||||
| 7 | "Artificial intelligence" has the same meaning set forth | |||||||||||||||||||||
| 8 | in Section 2-101 of the Illinois Human Rights Act. | |||||||||||||||||||||
| 9 | "Artificial intelligence companion" means a system using | |||||||||||||||||||||
| 10 | artificial intelligence, generative artificial intelligence, | |||||||||||||||||||||
| 11 | or emotional recognition algorithms designed to simulate a | |||||||||||||||||||||
| 12 | sustained human or human-like relationship with a user by: | |||||||||||||||||||||
| 13 | (1) retaining information on prior interactions or | |||||||||||||||||||||
| 14 | user sessions and user preferences to personalize the | |||||||||||||||||||||
| 15 | interaction and facilitate ongoing engagement with the | |||||||||||||||||||||
| 16 | artificial intelligence companion; | |||||||||||||||||||||
| 17 | (2) asking unprompted or unsolicited emotion-based | |||||||||||||||||||||
| 18 | questions that go beyond a direct response to a user | |||||||||||||||||||||
| 19 | prompt; and | |||||||||||||||||||||
| 20 | (3) sustaining an ongoing dialogue concerning matters | |||||||||||||||||||||
| 21 | personal to the user. | |||||||||||||||||||||
| 22 | "Artificial intelligence companion" does not include any | |||||||||||||||||||||
| 23 | system that is: | |||||||||||||||||||||
| |||||||
| |||||||
| 1 | (1) used by a business entity solely for customer | ||||||
| 2 | service or to provide users with information about | ||||||
| 3 | available commercial services or products provided by the | ||||||
| 4 | entity, customer service account information, or other | ||||||
| 5 | information strictly related to its customer service; | ||||||
| 6 | (2) primarily designed and marketed for providing | ||||||
| 7 | efficiency improvements, research, or technical | ||||||
| 8 | assistance; or | ||||||
| 9 | (3) used by a business entity solely for internal | ||||||
| 10 | purposes or employee productivity. | ||||||
| 11 | "Emotional recognition algorithms" means artificial | ||||||
| 12 | intelligence that detects and interprets human emotional | ||||||
| 13 | signals in text using natural language processing and | ||||||
| 14 | sentiment analysis, audio using voice emotion artificial | ||||||
| 15 | intelligence, video using facial movement analysis, gait | ||||||
| 16 | analysis, or physiological signals, or a combination of those | ||||||
| 17 | data processing tools. | ||||||
| 18 | "Human relationships" includes, but shall not be limited | ||||||
| 19 | to, intimate, romantic, or platonic interactions or | ||||||
| 20 | companionship. | ||||||
| 21 | "Operator" means any person, partnership, association, | ||||||
| 22 | firm, or business entity, or any member, affiliate, subsidiary | ||||||
| 23 | or beneficial owner of any partnership, association, firm, or | ||||||
| 24 | business entity who operates for or provides an artificial | ||||||
| 25 | intelligence companion to a user. | ||||||
| 26 | "Person" means any natural person. | ||||||
| |||||||
| |||||||
| 1 | "Self-harm" means intentional self-injury with or without | ||||||
| 2 | the intent to cause death. | ||||||
| 3 | "User" means any person who uses an artificial | ||||||
| 4 | intelligence companion for personal use in the State of | ||||||
| 5 | Illinois and who is not an operator or agent or affiliate of | ||||||
| 6 | the operator of the artificial intelligence companion. | ||||||
| 7 | Section 10. Prohibitions and requirements. An operator | ||||||
| 8 | shall not operate or provide an artificial intelligence | ||||||
| 9 | companion to a user unless the artificial intelligence | ||||||
| 10 | companion contains a protocol to take reasonable efforts to | ||||||
| 11 | detect and address suicidal ideation or expressions of | ||||||
| 12 | self-harm by a user to the artificial intelligence companion. | ||||||
| 13 | The protocol shall include, but shall not be limited to, | ||||||
| 14 | detection of user expressions of suicidal ideation or | ||||||
| 15 | self-harm and a notification to the user that refers them to | ||||||
| 16 | crisis service providers, such as the 9-8-8 Suicide and Crisis | ||||||
| 17 | Lifeline, a crisis text line, or other appropriate crisis | ||||||
| 18 | services upon detection of the user's expressions of suicidal | ||||||
| 19 | ideation or self-harm. | ||||||
| 20 | Section 15. Required notifications. An operator shall | ||||||
| 21 | provide a clear and conspicuous notification to a user that | ||||||
| 22 | states, either verbally or in text, that the user is not | ||||||
| 23 | communicating with a human, at the following times: | ||||||
| 24 | (1) the beginning of any artificial intelligence | ||||||
| |||||||
| |||||||
| 1 | companion interaction; and | ||||||
| 2 | (2) at least every 3 hours for continuing artificial | ||||||
| 3 | intelligence companion interactions. | ||||||
| 4 | Section 20. Enforcement. If the Attorney General believes | ||||||
| 5 | based on satisfactory evidence that an operator has engaged in | ||||||
| 6 | or is about to engage in conduct that violates this Act, the | ||||||
| 7 | Attorney General may bring an action to enjoin an operator | ||||||
| 8 | from continuing the unlawful conduct, and may seek civil | ||||||
| 9 | penalties of up to $15,000 per day that a violation occurs and | ||||||
| 10 | other remedies as the court may deem appropriate. All moneys | ||||||
| 11 | collected under this Act shall be deposited into the Statewide | ||||||
| 12 | 9-8-8 Trust Fund. | ||||||
| 13 | Section 25. The State Finance Act is amended by changing | ||||||
| 14 | Section 6z-134 as follows: | ||||||
| 15 | (30 ILCS 105/6z-134) | ||||||
| 16 | Sec. 6z-134. Statewide 9-8-8 Trust Fund. | ||||||
| 17 | (a) The Statewide 9-8-8 Trust Fund is created as a special | ||||||
| 18 | fund in the State treasury. This Fund is administered by the | ||||||
| 19 | Department of Human Services. Moneys in the Fund shall be used | ||||||
| 20 | by the Department of Human Services for the purposes of | ||||||
| 21 | establishing and maintaining a statewide 9-8-8 suicide | ||||||
| 22 | prevention and mental health crisis system pursuant to the | ||||||
| 23 | National Suicide Hotline Designation Act of 2020 as codified | ||||||
| |||||||
| |||||||
| 1 | in 47 U.S.C. 251 and 251a and any subsequent amendments, the | ||||||
| 2 | Federal Communication Commission's rules adopted to administer | ||||||
| 3 | the National Suicide Hotline Designation Act of 2020 as | ||||||
| 4 | codified in 47 U.S.C. 251 and 251a and any subsequent | ||||||
| 5 | amendments, and national guidelines for crisis care. The Fund | ||||||
| 6 | shall consist of: | ||||||
| 7 | (1) appropriations by the General Assembly; | ||||||
| 8 | (2) grants and gifts intended for deposit in the Fund; | ||||||
| 9 | (3) interest, premiums, gains, or other earnings on | ||||||
| 10 | the Fund; | ||||||
| 11 | (3.1) proceeds from the statewide 9-8-8 surcharge | ||||||
| 12 | imposed under Sections 3 and 4 of the Telecommunication | ||||||
| 13 | Excise Tax Act; and | ||||||
| 14 | (3.2) fees, fines, and penalties collected under the | ||||||
| 15 | Artificial Intelligence Companion Model Safety Act; and | ||||||
| 16 | (4) moneys received from any other source that are | ||||||
| 17 | deposited in or transferred into the Fund. | ||||||
| 18 | (b) Moneys in the Fund: | ||||||
| 19 | (1) do not revert at the end of any State fiscal year | ||||||
| 20 | but remain available for the purposes of the Fund in | ||||||
| 21 | subsequent State fiscal years; | ||||||
| 22 | (2) are not subject to transfer to any other Fund or to | ||||||
| 23 | transfer, assignment, or reassignment for any other use or | ||||||
| 24 | purpose outside of those specified in this Section; and | ||||||
| 25 | (3) shall be used by the Department of Human Services | ||||||
| 26 | to pay expenses pursuant to 47 U.S.C. 251a. | ||||||
| |||||||
| |||||||
| 1 | (c) An annual report of Fund deposits and expenditures | ||||||
| 2 | shall be made to the General Assembly and the Federal | ||||||
| 3 | Communications Commission by the Department of Human Services | ||||||
| 4 | pursuant to 47 U.S.C. 251a. | ||||||
| 5 | (d) (Blank). | ||||||
| 6 | (e) For the purposes of this Section, "statewide 9-8-8 | ||||||
| 7 | suicide prevention and mental health crisis system" means the | ||||||
| 8 | core elements or pillars of the crisis system, as described by | ||||||
| 9 | the Substance Abuse and Mental Health Services Administration, | ||||||
| 10 | and includes Illinois' 9-8-8 Lifeline Contact Centers, | ||||||
| 11 | community crisis response services, including mobile crisis | ||||||
| 12 | teams, and crisis receiving and stabilization facilities and | ||||||
| 13 | programs, including Living Room Programs. | ||||||
| 14 | (Source: P.A. 104-6, eff. 6-16-25.) | ||||||
| 15 | Section 97. Severability. The provisions of this Act are | ||||||
| 16 | severable under Section 1.31 of the Statute on Statutes. | ||||||
| 17 | Section 99. Effective date. This Act takes effect January | ||||||
| 18 | 1, 2027. | ||||||
