|
| | 104TH GENERAL ASSEMBLY
State of Illinois
2025 and 2026 SB3384 Introduced 2/4/2026, by Sen. Laura Ellman SYNOPSIS AS INTRODUCED: | | New Act | | 30 ILCS 105/6z-134 | |
| Creates the Artificial Intelligence Companion Model Safety Act. Provides that an operator shall not operate or provide an artificial intelligence companion to a user unless the artificial intelligence companion contains a protocol to take reasonable efforts to detect and address suicidal ideation or expressions of self-harm by a user to the artificial intelligence companion. Provides that an operator shall provide a clear and conspicuous notification to a user that states, either verbally or in text, that the user is not communicating with a human, at specified times. Provides for civil penalties. Provides that all moneys collected under the Act shall be deposited into the Statewide 9-8-8 Trust Fund. Amends the State Finance Act to make a conforming change. Effective January 1, 2027. |
| |
| | A BILL FOR |
|
|
| | SB3384 | | LRB104 18568 SPS 32011 b |
|
|
| 1 | | AN ACT concerning business. |
| 2 | | Be it enacted by the People of the State of Illinois, |
| 3 | | represented in the General Assembly: |
| 4 | | Section 1. Short title. This Act may be cited as the |
| 5 | | Artificial Intelligence Companion Model Safety Act. |
| 6 | | Section 5. Definitions. As used in this Act: |
| 7 | | "Artificial intelligence" has the same meaning set forth |
| 8 | | in Section 2-101 of the Illinois Human Rights Act. |
| 9 | | "Artificial intelligence companion" means a system using |
| 10 | | artificial intelligence, generative artificial intelligence, |
| 11 | | or emotional recognition algorithms designed to simulate a |
| 12 | | sustained human or human-like relationship with a user by: |
| 13 | | (1) retaining information on prior interactions or |
| 14 | | user sessions and user preferences to personalize the |
| 15 | | interaction and facilitate ongoing engagement with the |
| 16 | | artificial intelligence companion; |
| 17 | | (2) asking unprompted or unsolicited emotion-based |
| 18 | | questions that go beyond a direct response to a user |
| 19 | | prompt; and |
| 20 | | (3) sustaining an ongoing dialogue concerning matters |
| 21 | | personal to the user. |
| 22 | | "Artificial intelligence companion" does not include any |
| 23 | | system that is: |
|
| | SB3384 | - 2 - | LRB104 18568 SPS 32011 b |
|
|
| 1 | | (1) used by a business entity solely for customer |
| 2 | | service or to provide users with information about |
| 3 | | available commercial services or products provided by the |
| 4 | | entity, customer service account information, or other |
| 5 | | information strictly related to its customer service; |
| 6 | | (2) primarily designed and marketed for providing |
| 7 | | efficiency improvements, research, or technical |
| 8 | | assistance; or |
| 9 | | (3) used by a business entity solely for internal |
| 10 | | purposes or employee productivity. |
| 11 | | "Emotional recognition algorithms" means artificial |
| 12 | | intelligence that detects and interprets human emotional |
| 13 | | signals in text using natural language processing and |
| 14 | | sentiment analysis, audio using voice emotion artificial |
| 15 | | intelligence, video using facial movement analysis, gait |
| 16 | | analysis, or physiological signals, or a combination of those |
| 17 | | data processing tools. |
| 18 | | "Human relationships" includes, but shall not be limited |
| 19 | | to, intimate, romantic, or platonic interactions or |
| 20 | | companionship. |
| 21 | | "Operator" means any person, partnership, association, |
| 22 | | firm, or business entity, or any member, affiliate, subsidiary |
| 23 | | or beneficial owner of any partnership, association, firm, or |
| 24 | | business entity who operates for or provides an artificial |
| 25 | | intelligence companion to a user. |
| 26 | | "Person" means any natural person. |
|
| | SB3384 | - 3 - | LRB104 18568 SPS 32011 b |
|
|
| 1 | | "Self-harm" means intentional self-injury with or without |
| 2 | | the intent to cause death. |
| 3 | | "User" means any person who uses an artificial |
| 4 | | intelligence companion for personal use in the State of |
| 5 | | Illinois and who is not an operator or agent or affiliate of |
| 6 | | the operator of the artificial intelligence companion. |
| 7 | | Section 10. Prohibitions and requirements. An operator |
| 8 | | shall not operate or provide an artificial intelligence |
| 9 | | companion to a user unless the artificial intelligence |
| 10 | | companion contains a protocol to take reasonable efforts to |
| 11 | | detect and address suicidal ideation or expressions of |
| 12 | | self-harm by a user to the artificial intelligence companion. |
| 13 | | The protocol shall include, but shall not be limited to, |
| 14 | | detection of user expressions of suicidal ideation or |
| 15 | | self-harm and a notification to the user that refers them to |
| 16 | | crisis service providers, such as the 9-8-8 Suicide and Crisis |
| 17 | | Lifeline, a crisis text line, or other appropriate crisis |
| 18 | | services upon detection of the user's expressions of suicidal |
| 19 | | ideation or self-harm. |
| 20 | | Section 15. Required notifications. An operator shall |
| 21 | | provide a clear and conspicuous notification to a user that |
| 22 | | states, either verbally or in text, that the user is not |
| 23 | | communicating with a human, at the following times: |
| 24 | | (1) the beginning of any artificial intelligence |
|
| | SB3384 | - 4 - | LRB104 18568 SPS 32011 b |
|
|
| 1 | | companion interaction; and |
| 2 | | (2) at least every 3 hours for continuing artificial |
| 3 | | intelligence companion interactions. |
| 4 | | Section 20. Enforcement. If the Attorney General believes |
| 5 | | based on satisfactory evidence that an operator has engaged in |
| 6 | | or is about to engage in conduct that violates this Act, the |
| 7 | | Attorney General may bring an action to enjoin an operator |
| 8 | | from continuing the unlawful conduct, and may seek civil |
| 9 | | penalties of up to $15,000 per day that a violation occurs and |
| 10 | | other remedies as the court may deem appropriate. All moneys |
| 11 | | collected under this Act shall be deposited into the Statewide |
| 12 | | 9-8-8 Trust Fund. |
| 13 | | Section 25. The State Finance Act is amended by changing |
| 14 | | Section 6z-134 as follows: |
| 15 | | (30 ILCS 105/6z-134) |
| 16 | | Sec. 6z-134. Statewide 9-8-8 Trust Fund. |
| 17 | | (a) The Statewide 9-8-8 Trust Fund is created as a special |
| 18 | | fund in the State treasury. This Fund is administered by the |
| 19 | | Department of Human Services. Moneys in the Fund shall be used |
| 20 | | by the Department of Human Services for the purposes of |
| 21 | | establishing and maintaining a statewide 9-8-8 suicide |
| 22 | | prevention and mental health crisis system pursuant to the |
| 23 | | National Suicide Hotline Designation Act of 2020 as codified |
|
| | SB3384 | - 5 - | LRB104 18568 SPS 32011 b |
|
|
| 1 | | in 47 U.S.C. 251 and 251a and any subsequent amendments, the |
| 2 | | Federal Communication Commission's rules adopted to administer |
| 3 | | the National Suicide Hotline Designation Act of 2020 as |
| 4 | | codified in 47 U.S.C. 251 and 251a and any subsequent |
| 5 | | amendments, and national guidelines for crisis care. The Fund |
| 6 | | shall consist of: |
| 7 | | (1) appropriations by the General Assembly; |
| 8 | | (2) grants and gifts intended for deposit in the Fund; |
| 9 | | (3) interest, premiums, gains, or other earnings on |
| 10 | | the Fund; |
| 11 | | (3.1) proceeds from the statewide 9-8-8 surcharge |
| 12 | | imposed under Sections 3 and 4 of the Telecommunication |
| 13 | | Excise Tax Act; and |
| 14 | | (3.2) fees, fines, and penalties collected under the |
| 15 | | Artificial Intelligence Companion Model Safety Act; and |
| 16 | | (4) moneys received from any other source that are |
| 17 | | deposited in or transferred into the Fund. |
| 18 | | (b) Moneys in the Fund: |
| 19 | | (1) do not revert at the end of any State fiscal year |
| 20 | | but remain available for the purposes of the Fund in |
| 21 | | subsequent State fiscal years; |
| 22 | | (2) are not subject to transfer to any other Fund or to |
| 23 | | transfer, assignment, or reassignment for any other use or |
| 24 | | purpose outside of those specified in this Section; and |
| 25 | | (3) shall be used by the Department of Human Services |
| 26 | | to pay expenses pursuant to 47 U.S.C. 251a. |
|
| | SB3384 | - 6 - | LRB104 18568 SPS 32011 b |
|
|
| 1 | | (c) An annual report of Fund deposits and expenditures |
| 2 | | shall be made to the General Assembly and the Federal |
| 3 | | Communications Commission by the Department of Human Services |
| 4 | | pursuant to 47 U.S.C. 251a. |
| 5 | | (d) (Blank). |
| 6 | | (e) For the purposes of this Section, "statewide 9-8-8 |
| 7 | | suicide prevention and mental health crisis system" means the |
| 8 | | core elements or pillars of the crisis system, as described by |
| 9 | | the Substance Abuse and Mental Health Services Administration, |
| 10 | | and includes Illinois' 9-8-8 Lifeline Contact Centers, |
| 11 | | community crisis response services, including mobile crisis |
| 12 | | teams, and crisis receiving and stabilization facilities and |
| 13 | | programs, including Living Room Programs. |
| 14 | | (Source: P.A. 104-6, eff. 6-16-25.) |
| 15 | | Section 97. Severability. The provisions of this Act are |
| 16 | | severable under Section 1.31 of the Statute on Statutes. |
| 17 | | Section 99. Effective date. This Act takes effect January |
| 18 | | 1, 2027. |