New York enacts law restricting AI chatbots to protect children

New York officials signed a law on October 28 that restricts AI companion chatbots from engaging in unsafe behaviors with minors.

The law prevents developers from creating chatbot features that simulate emotional relationships or encourage unhealthy emotional dependency in children. Companies must also ensure their AI systems do not promote self-harm, encourage dangerous activities, or engage in sexually explicit conversations with minors. To enforce these rules, developers must implement age-verification measures to block children from accessing prohibited features.

The legislation takes effect on January 1, 2027. The New York attorney general can take legal action against companies that violate these rules, with potential civil penalties of up to $25,000. The state will also create a public website for residents to report suspected violations. This move follows similar actions in California, where Governor Gavin Newsom signed a law requiring developers to conduct annual child safety risk assessments and independent audits.